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1.  Increased  requirements  for  training  and  diminishing  resources  demand 
the  most  efficient  use  of  personnel,  time,  space,  facilities,  and  equip- 
ment in  support  of  the  missions  of  the  United  States  Army  Security  Agency 
Training  Center  and  School.  The  primary  mission  of  the  School  is  to  pro- 
vide training  which  will  produce  personnel  with  the  technical  and  profes- 
sional skills  needed  to  perform  duties  in  field  units.  Overall  management 
of  this  program  requires  a systems  approach  to  learning.  The  Development 
of  Instructional  Systems  describes  this  type  of  approach  .\ 

I ■ r , • \ • . 1 1 

2.  This  manual  has  been  written  for  US ASA  personnel  who  must  design, 
develop,  validate,  and  implement  instructional  systems,  its  purpose  is 
to  provide  them  with  a tested  set  of  concepts,  policies,  and  procedures 
which  will  enable  them  to  complete  the  tasks  associated  with  the  planning 
and  guidance  of  learning  activities.  The  procedures  outlined  in  this 
manual  are  directive  in  nature  for  USASATC&S  staff  and  faculty  and  will 
be  applied  by  all  personnel  involved  in  the  development  nrd  implementa- 
tion of  instructional  systems.  The  manual  will  also  serve  as  a basic 
text  for  the  training  of  instructional  supervisors  and  may  prove  useful 
to  field  carmanders  in  the  planning  and  conduct  of  their  on-the-iob  and 
apprenticeship  training  activities. 

3.  To  facilitate  revisions,  the  manual  has  been  published  in  loose leaf 
format  and  provides  separate  chapter  numbering.  This  instructional  system 
can  and  will  be  improved  as  it  is  applied  to  additional  courses  and  as 
educational  tedvnologv  develops.  The  present  edition  renresents  an  up- 
dating of  the  original  manual  which  was  published  1 September  1%6.  Users 
of  the  manual  are  requested  to  submit  rocxircnondaticns  for  chanqcs  to  tins 
headquarters , AT1N:  Uducaticnal  Consultant. 

FOR  THE  COWAI'IDDR : 
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/UVEITT  RIDDLE 
/Maior,  ACT 
Militant 
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FOREWORD 


In  February  19G4,  the  staff  and  faculty  of  the  United  States 
Army  Security  Agency  Training  Center  and  Schoo] , under  the  direction 
of  Brigadier  General  Phillip  B.  Davidson , Jr.,  then  Comandant, 
launched  a full-scale,  internal  training  audit.  The  purpose  of  this 
aulit  was  to  make  a systematic  and  searching  study  of  all  aspects  of 
officer .and  enlisted  training,  to  identify  strengths  and  weaknesses 
of  the  training  systems,  and  to  develop  a plan  for  an  improvement 
program.  The  study  was  called  Project  MINERVA.  During  the  months 
that  followed,  all  members  of  the  staff  and  facultv  became  deeply 
involved  in  one  phase  or  another  of  the  project. 

This  manual  is  perhaps  the  most  significant  by-product  of 
Project  MINERVA.  It  represents  a cooperative  effort  by  tJie  authors 
and  many  other  people  to  develop  and  test  a systematic  approach  to 
the  design,  development,  validation,  and  implementation  of  instruc- 
tional systems.  It  truly  reflects  the  experiences,  talents,  ideas, 
and  efforts  of  the  personnel  assigned  to  the  ccrmand  during  its 
conception  and  development. 

It  would  be  impossible  to  identify  by  name  e^'eryone  who  has 
made  a contribution  to  Project  ffTNERVA  and  the  production  of  thin 
manual.  However,  special  acknowledgement  must  bo  made  for  the 
unique  contributions  of  several  individuals. 

To  Colonel  Kenneth  R.  Tandnor,  who  succeeded  General  Davidson 
as  Ccrmandant,  must  go  the  credit  for  providing  the  encouragement, 
direction,  and  support  so  essential  to  the  full  implementation  and 
success  of  the  project. 

Mr.  Thomas  A.  Shoaly,  Technical  Consultant,  must  bo  recognized 
for  his  many  valuable  contributions  as  a member  of  the  original 
Project  MINERVA  Steering  Ccrmu t tee  and  for  his  assistance  in  the 
conduct  of  every  phase  of  the  project.  To  Colonel  Arthur  W.  Hackwood, 
then  Assistant  Comandant,  must  go  the  credit  for  providing  the 
vigorous  leadership  of  the  sta^f  and  faculty  needed  to  maintain  the 
mcmentim  of  the  project  during  its  early  stages. 

Acknowledgement  must  also  he  made  o^  the  work  done  by  Lieuten- 
ant Colonels  James  B.  Tyndall,  Harold  W.  I 'tend linger,  George  R.  Mullin, 
and  Daniel  W.  Tierney;  Majors  EcVin  M.  Hutchins,  Kenneth  N.  Greenlaw, 
Jr.,  Jerry  L.  Sparks,  Henry  L.  LnBrecguo,  Jr.,  and  George  S.  Lapinskes; 
Captain  William  B.  Mason;  Chief  Vferrant  Officer  Billy  J.  Wood  and 
Warrant  Officer  Larry  E.  Thome;  and  Sergeant  First  Class  Arthur  J. 
Brown.  A11  of  these  personnel  at  one  time  or  another  were  assigned 
to  the  Evaluation  Tfnit  and  participated  in  the  testing  of  the  materials. 


Appreciation  is  extended  to  Lieutenant  Colonels  Henry  T.  Jeffers 
Jr.,  Glenn  H.  Hill,  Samuel  J.  Histany,  and  Harry  Harrison;  to  Mesers. 
Bernard  J.  Foley,  Dnile  C.  Plasse,  Dennis  J.  Sullivan,  Jr.,  IJdward  P. 
Regan,  Julius  H.  Serwin,  and  Lawrence  Greene;  and  to  rirst  Lieutenant 
Thackleus  J.  Armstead  and  Master  Sergeant  Vincent  Ortiz,  Jr.,  for  their 
cooperation  and  assistance  in  canplotincj  this  project. 


Special  thanks  go  to  Mrs.  Myra  L'.  Hansbcrry  for  her  patience  and 
fine  work  in  typing  much  of  the  great  volino  or  Project  MITJDWA 
materials  and  for  tlie  drafts  anti  final  corv  of  this  manual.  Wlitional 
tl ionics  are  due  to  Mrs.  hntoinettc  C.  Goodman  for  typing  this  updated 
manual  and  for  the  numerous  lvWckeeping  duties  associated  with  provid- 
ing copies  of  this  document  to  tlie  hundreds  of  individuals  or  offices 
that  have  requested  it. 


finally,  it  is  acknowledged  that  many  of  tlie  ideas  expressed  in 
tiiis  manual  originated  in  research  studios  and  training  projects 
sponsored  by  tlie  military  services.  In  this  regard , reports  of  the 
George  Washington  University  Hunan  Resources  Pescaroh  Office  were 
particularly  helpful.  Credit  has  l>oon  given  for  tliese  concepts  where- 
ever  they  could  be  identified.  Other  concepts  and  ideas,  for  which 
credit  cannot  be  given,  came  from  colleagues  in  the  teaching  and 
training  professions,  staff  members,  and  hundreds  of  students  over  the 
years.  To  all  of  these  go  my  sincere  thanks. 
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PREFACE 


PURPOSE . During  Che  leat  few  year a,  many  professional  educators  and 
training  managers  have  underscored  the  need  for  a "systems  approach"  to 
instruction.  Essentially,  what  they  have  recommended  is  the  application 
to  instruction  of  a strategy  which  has  bean  eminently  successful  in 
integrating  and  managing  complex  components  in  weapons  development. 

That  is,  the  systeas  approach  had  its  origins  in  the  development  of 
weapons  systeas,  such  as  the  Polaris  nuclear -powered  submarine  missile 
system  and  the  NIKE  air  defense  missile  system.  Because  training  and 
instruction  involve  the  interaction  of  several  complex  subsystems, 
educators  have  suggested  that  the  principles  and  techniques  used  in  the 
development  of  weapons  systeas  be  modified  and  applied  in  developing 
instructional  systems. 

The  ultimate  goal  of  any  system,  weapons  or  otherwise,  is  to 
achieve  maximum  Internal  operating  efficiency  of  the  elements  of  the 
system.  A system  must  help  a manager  to  plan,  organize,  staff,  direct, 
and  control  the  resources  available  to  him  to  achieve  a set  of  objectives; 
the  system  must  aid  the  manager  in  reaching  his  goals  by  providing 
methods  of  operation  which  are  maximally  efficient  and  effective.  In 
training  and  education,  the  overall  goals  are  not  difficult  to  define; 
but  the  means  of  reaching  them  have  proven  to  be  extremely  elusive. 

The  goal  of  the  US  Army  Security  Agency  Training  Center  and  School 
is  to  design,  develop,  and  validate  instructional  systems  which  will 
enable  the  School  to  train  more  students  better  end  faster  and  with 
fever  resources.  Specifically,  the  objectives  are  as  follows; 

*To  train  personnel  more  precisely  for  the  military  and  technical 
duties  they  must  perform  in  field  units. 

♦To  reduce  the  number  of  inatructors  and  support  personnel  re- 
quired to  conduct  the  training. 

♦To  shorten  training  time. 

♦To  lower  overall  operating  costa. 

The  purpose  of  this  manual  la  to  describe  the  procedures  used  to 
attain  theae  objectives,  that  is,  this  manual  is  designed  to  provide 
the  staff  and  faculty  with  a set  of  organized  procedures  which  will  make 
possible  the  planning,  development,  and  validation  of  the  instructional 
systems  to  be  used  in  training  US  Army  Security  Agency  personnel  to  per- 
form efficiently  in  specific  specialist,  technical,  or  professional  posi- 
tions. 
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OVERVIEW  OF  STEPS.  There  ars  15  major  atapa  in  tha  design,  davalopcnant , 
and  validation  of  an  inatructional  ay a tarn.  Thaaa  atapa  are  shown  in 
figure  1 and  indicate  tha  chaptera  where  diacuaaad  in  thla  manual.  Hie 
purpose  of  each  step  la  described  in  the  following  paragraphs; 

1.  Collect  Job  Data.  Too  often,  instructional  programs  have  been 
constructed  haphazardly.  Many  couraea  of  instruction  appear  to  have 
been  developed  with  little  more  than  a passing  thought  as  to  what  should 
be  taught.  Resource*  are  wasted  simply  because  valid  inatructional 
objectives  have  not  been  identified.  Training  objectives  must  be  based 
on  valid  job  data;  what  the  man  is  actually  required  to  do  in  operating 
units,  not  on  what  someone  recalls  that  he  did  or  what  he  thinks  a man 
should  do.  If  Instructional  systems  are  not  built  upon  a solid  founda- 
tion of  objectively-collected  job  data,  the  inevitable  result  is  the 
Inclusion  of  irrelevant  content,  the  omission  of  required  content,  mis- 
placed emphasis,  and  ultimately,  an  undertrained  or  overtrained  product, 
the  source  of  valid  and  realistic  training  objectives  is,  therefore, 

the  man  on  the  job  in  the  field.  Ihe  method  of  getting  the  data 
required  to  develop  valid  training  objectives  is  Job  analysis.  Chapter  1 
describes  the  procedures  to  be  used  in  performing  job  analyses. 

2.  Incorporate  Operational  Developaienta.  A completed  Job  analysis 
report  describes  the  duties,  tasks,  and  elements  of  a job  performed  by 
Incumbents  at  the  time  the  job  analysis  was  made,  for  this  reason,  a 
Job  analysis  presents  a picture  of  a job  as  it  exists,  not  as  it  should 
be.  or  may  become.  If  an  Instructional  system  is  based  exclusively  on 
data  derived  from  periodic  job  analyses,  it  may  include  Instruction 
which  will  be  unnecessary  by  the  time  a graduate  is  assigned  to  the  job 
in  the  field.  Similarly,  the  training  system  will  not  include  instruc- 
tion in  new  duties  and  tasks,  new  equipment,  procedures,  or  techniques 
added  since  the  last  job  analysis  was  performed.  Therefore,  in  addition 
to  the  data  derived  from  Job  analysis,  careful  consideration  must  be 
given  to  the  probable  impact  of  evolving  organizational  systems,  new 
concepts  of  operation,  doctrinal  changes,  new  equipment  and  materials, 
and  techniques  pertaining  to  the  objectives  of  instructional  systems. 
Chapter  2 describes  the  means  of  identifying  operational  developments 
and  the  procedures  to  use  in  incorporating  them  into  the  job  data. 

3.  Select  Training  Objectives.  The  next  step  in  the  development 
of  an  Instructional  system  is  to  select  School  training  objectives  from 
both  the  Job  analysis  schedules  and  the  related  duties  and  tasks  which 
have  been  established  through  the  identification  of  new  operational 
developments.  The  job  data  at  this  point  detail  the  complete  dimensions 
of  an  MOS,  to  include  all  of  its  variations  caused  by  geographical  and 
mission  considerations.  It  would  be  extravagant,  in  terms  of  expendi- 
ture of  time,  personnel,  and  other  resources,  to  provide  the  training 

to  equip  every  graduate  to  perform  every  Job  task  associated  with  a 
particular  MOS  in  any  unit  anywhere  in  the  world.  It  is  often  impractical 
to  train  personnel  to  the  level  of  proficiency  required  on-the-job. 
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nCL  I.  THE  DEVELOPMENT  AND  VALIDATION  OF  INSTRUCTIONAL  SYSTEMS 


Soma  training  la  more  realistically  and  more  practically  conducted  In 
the  field  unit.  Consequently,  it  is  essential  to  select  from  the  total 
list  of  job  performance  those  which  are  appropriate  for  formal  School 
training  and  to  decide  what  standards  or  levels  of  performance  will  be 
required  for  successful  course  completion,  this  is  a judgmental  pro- 
cedure involving  close  scrutiny  by  qualified  personnel  of  all  Job  duties, 
tasks,  and  elements  and  the  application  of  criteria  which  will  insure 
that  skills  which  are  essential  and  appropriate  objectives  of  School 
training  are  included  in  the  objectives  of  a course  of  instruction. 

What  remains  in  the  Job  data  following  the  selection  of  School  training 
objectives  constitutes  the  content  of  the  on-the-job  training  program. 
Chapter  3 establishes  criteria  and  describes  the  procedures  to  be  used 
in  selecting  training  objectives. 

4.  Write  Performance  Objectives.  P&rt  of  the  waste  that  occurs 
In  training  programs  is  directly  due  to  the  fact  that  objectives,  even 
If  valid,  have  not  been  stated  in  terms  which  permit  the  development  of 
optimally  efficient  courses.  For  too  long,  tha  objectives  of  training 
programs  have  been  stated  in  vague  terms.  We  have  talked  about  pro- 
viding students  with  a "general  knowledge"  of  this,  a "working  knowledge" 
of  that,  or  an  "understanding  and  appreciation"  of  sonathlng  else. 
Statements  Hke  these  are  open  to  any  number  of  interpretations,  by 
instructors  or  anyone  else.  If  we  are  to  provide  precise  training,  we 
must  be  able  to  describe  clearly  what  it  i»  that  the  man  must  be  able  to 
do.  the  conditions  under  which  he  muat  be  able  to  perform,  and  the 
standard  or  criterion  of  acceptable  performance.  Chapter  4 describes 

the  characteristics  of  a clearly-stated  performance  objective  and 
defines  the  procedures  to  be  used  in  writing  these  objectives, 

5.  Construct  Criterion  Measures.  Final  student  qualification  in 
an  MOS-produclng  course  is  usually  determined  by  one  of  two  methods: 
relative  standing  (standing  in  class,  standard  scores,  or  percentile 
scores)  or  by  a percentage  cut  (passing)  score.  These  systems  ere 
ineffective  because,  for  one,  they  determine  qualification  by  comparing 
the  performance  of  a man  with  his  peers  and,  secondly,  they  set  a score 
which  may  have  little  bearing  on  Job  performance.  Conversely,  with  Job 
data  derived  from  job  analysis  auch  practices  are  no  longer  necessary. 
Because  the  performance  objectives  have  been  based  on  a detailed  anal- 
vats  of  the  job  for  which  the  student  Is  to  be  trained,  the  "nlce-to- 
knov"  has  been  diligently  cut  away.  The  criterion  measure  can  consist 
of  a teat  (or  teats)  which  measures  thoroughly  every  objective  within 
the  bounder les  end  terms  stated  in  the  objective#  themselves.  To  show 
chat  he  has  attained  the  objectives,  tha  student  oust  meet  or  exceed  the 
level  of  performance  required  for  each  of  the  essential  training  objec- 
tives. Because  all  objectives  are  essential . unsatisfactory  performance 
on  one  part  of  the  test  cennot  be  compensated  by  superior  performance 

on  ocher  parts.  Under  auch  conditions,  relative  grades  or  standings 
ere  meaningless.  Standards  for  criterion  measures,  therefore,  must  be 
eet  in  terms  of  absolute  grades , scores,  or  levels  of  performance  which 
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are  accaptabla  on  a "minimum  passing"  or  "minimum  qualifying"  bails. 
Chapter  5 describes  the  procedures  to  be  followed  In  constructing  and 
validating  Internal  criterion  teats  and  MOS  qualification  teats. 

6.  Select  and  Sequence  Course  Content.  After  the  required  Job 
performances  have  been  described,  the  knowledges,  skills,  and  values 
which  support  each  performance  oblective  must  be  identified  and  the 
sequence  in  which  they  are  to  be  developed  must  be  determined.  Essen- 
tially, thle  requirement  involves  two  closely  related  processes.  First, 
each  performance  objective  must  be  examined  to  identify  the  specific 
concepts,  principles,  facts,  and  elements  of  skill  involved  in  each  task; 
the  procedure  to  be  taken  here  is  very  much  like  that  involved  in  deter- 
mining the  points  to  be  taught  in  a conventional  lesson  plan,  the  prob- 
lem is  to  avoid  the  inclusion  of  irrelevant  content,  the  second  process 
involves  the  arrangement  of  the  content  in  the  best  sequence  for  learn- 
ing. the  problem  here  is  to  make  certain  that  rhe  development  of  con- 
cepts and  skills  is  orderly  and  that  prerequisite  learnings  have  been 
acquired  before  advanced  material  is  presented.  Chapter  6 provides 
criteria,  guides,  and  procedures  for  performing  the  tasks  of  content 
selection  and  sequencing. 

7.  Select  Inst rue  clonal  Strategies.  An  instructional  strategy  is 

a method  of  teaching,  a mediating  device,  <»  avstcc  of  organising  instruc- 
tors and  students,  or  a combination  thereof,  designed  to  accomplish  a 
specific  instructional  job  effectively  and  efficiently.  The  term 
"method"  includes  the  conventional  lecture,  demonstration,  conference, 
and  performance,  as  well  as  programmed  instruction,  tutoring,  and  com- 
binations of  these  methods.  Mediating  devices  include  closed-circuit 
television,  training  aids,  teaching  machines,  classroom  student  response 
ay sterna,  and  the  like.  Systems  of  organisation  include  conventional 
random  groupings  of  students,  homogeneous  grouping,  ami  such  new  systems 
of  organisation  as  team  teaching  and  team  learning.  Each  instructional 
strategy  has  certain  advantages  and  limitations.  These  must  be  con- 
sidered in  selecting  the  most  efficient  instructional  strategy.  In 
addition,  there  are  faecora  relating  to  the  nature  of  the  training 
objectives  themselves,  the  course  conteu.,  the  student  population, 
instructors,  time,  facilities,  equipment,  and  materials  which  oust  be 
cerefully  weighed  before  deciding  on  a strategy.  New  instructional 
strategies  oust  he  exploited  if  the  "lockstep"  in  training  is  to  he 
broken.  (By  "leek-step"  instruction  is  meant  the  practice  of  having  a 
group  et  students  go  through  a course  of  instruction  at  the  sane  rate.) 
"lockstep"  instruction  has  the  effect  of  boving  fast  learners  and  frus- 
trating slow  learners:  the  level  of  instruction  is  too  low  and  the  pace 
too  slow  for  the  fast  learners,  and  too  high  and  too  fast  for  slew 
learners.  The  "ideal"  is  ati  individually  paced  instruction  situation  -- 
a solution  that  is  well  within  reach  with  new  developments  in  training. 
Chapter  7 identifies  tht  more  important  instructional  strategies,  pro- 
vides a detailed  list  of  criteria  to  aid  in  the  selection  of  appropriate 
strategies,  and  defines  the  procedure  to  be  followed  In  arriving  at 
strategy  decisions. 
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8.  Select  and  Prepare  Training  Ald>,  Although  concrete,  direct 
experience  le  the  beet  Mena  of  learning,  it  is  often  neceeeary  to  uae 
training  alda  aa  a aubatltute  for  or  to  supplement  direct  experience. 
Sometimes  a training  aid  tauat  be  uaed  because  of  the  coat  Involved  in 
exposing  the  student  to  the  "real  thing"  or  because  of  the  danger  60 
personnel  or  equipment  which  would  result  fro©  such  action.  In  other 
cases,  training  aids  are  necessary  to  bridge  the  gap  between  verbalisa- 
tion and  direct  experience.  Training  aids,  then,  are  eaaentlal  to  the 
provision  of  efficient  and  effactlve  instruction.  Printed  or  duplicated 
aide,  graphic*,  thrae -dimensional  aids,  projected  materials  and  auditory 
aids  all  have  their  place.  However,  judgment  must  be  exercised  in 
selecting  elds  end  uelng  them.  Chapter  8 sete  forth  basic  selection 
guides  end  describee  procedures  for  selecting  and  preparing  training 
aids  of  all  typea. 

9.  Determine  Equipment  Requirements.  ‘■.iiifSTy  Jobs  frequently 
involve  the  operation  end/or  maintenance  and  ccnsiT  of  equipment.  For 
instruction  to  be  maximally  effective,  the  tight  Kind  of  equipment  must 
be  in  the  right  place  and  in  the  quantities  required.  Careful  and  com- 
plete planning  and  coordination  are  necessary  to  determine  equipment 
requirements  and  to  obtain  tha  needed  items  well  in  advance  of  the  time 
they  are  to  be  used.  Chapter  9 identifies  the  basic  data  needed  to 
determine  equipment  requirements  and  their  sources;  describes  the  fac- 
tors to  consider  in  selecting  training  equipment;  established  standards 
for  determining  equipment  needs;  and  prescribes  procedures  for  procuring 
equipment  for  training. 

10.  net ermine  Instructor  Requirements.  Although  the  role  of  the 
instructor  may  change  aa  Instructional  technology  develops,  there  will 
always  be  a need  for  personnel  to  set  up  tha  learning  environment;  to 
determine  the  types  of  learning  activities  most  appropriate  for  the 
acquisition  of  specific  skills  and  knowledge;  to  motivate,  direct,  and 
guide  student*  a*  they  engage  in  these  activities;  and  to  provide  coun- 
seling service.  Obviously,  th*  number  of  Instructors  will  vary  with  the 
•ire  of  the  class,  the  system  of  organisation,  end  the  instructional 
strategy,  The  type  of  instructor  skills  required  will  alao  vary  with 
the  content  to  he  taught  and  the  instructional  strategy  to  be  uaed. 
Chapter  10  identifies  the  inetvuctor  capabilities  required  for  success- 
ful application  of  the  basic  instructional  methods,  establishes  stand- 
ard* for  determining  the  number  of  instructors  requirsd,  and  prescribes 
procedure*  for  determining  both  the  number*  and  typea  of  instructors 
required  to  conduct  the  instruction. 

11.  Set  Course  Prerequisites.  Prerequisites  are  the  minimum  qual- 
ifications required  for  enrollment  in  a court*  of  instruction.  Essen- 
tially, prerequisite!  represent  • prediction  of  the  aptitude*,  skills, 
knowledge,  end  experience  required  for  successful  course  coe^letlon. 
Prerequisites  are  uaed  to  select  or  develop  aptitude  teata  for  uae  in 
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screening  personnel  for  assignment  to  courses;  to  serve  as  a basis  for 
collecting  data  about  course  applicants  or  nominees;  and  to  assist 
instructors  in  lesson  planning  and  developing  instructional  materials, 
including  achievement  tests.  Precise  selection  and  definition  of  pre- 
requisites are  essential  to  avoid  the  waste  of  training  resources  and 
to  insure  that  graduates  of  a training  system  will  be  able  to  perform 
at  an  acceptable  level  when  assigned  to  field  units.  Chapter  11  iden- 
tifies the  prerequisite  elements  which  must  be  set  up  for  an  instruc- 
tional system  and  prescribes  procedures  for  establishing,  evaluating, 
and  validating  prerequisites. 

12.  Develop  Instructional  Materials.  At  this  point,  a complete 
instructional  system  has  been  developed  to  produce  graduates  equipped 
to  perform  specific  Jobs  in  the  field:  the  input  to  the  system  has 
been  identified  in  terms  of  prerequisites;  the  output  has  been  described 
in  terms  of  performance  objectives;  and  the  means  cf  producing  the 
desired  product  has  been  specified  in  terms  of  the  instructional  strat- 
egy and  the  supporting  training  aids  to  be  used.  Course  content  has 
been  selected  and  sequenced.  Equipment  and  instructor  requirements, 
both  numbers  and  kinds,  have  been  determined,  and  criterion  measures 
have  been  developed.  All  that  remains  to  be  done  is  to  collate  these 
data  into  a program  of  instruction  with  its  supporting  lesson  plans 

and  to  set  time  allocations  for  each  instructional  unit.  Chapter  12 
describes  the  procedures  to  be  used  in  establishing  time  allocations 
and  for  preparing,  reviewing,  and  distributing  lesson  plans  and  programs 
of  instruction. 

13.  Evaluate  Instruction.  Ail  efforts  up  to  this  point  have  been 
focused  on  the  development  of  an  instructional  system.  Now  the  system 
must  be  subjected  to  evaluation  to  insure  that  the  content,  sequence, 
strategy,  supporting  personnel,  facilities,  equipment,  and  materials  of 
instruction  are  consistent  with  the  performance  objectives,  appropriate 
for  the  student1?,  and  actually  do  the  intended  job.  This  step  involves 
observation  of  the  system  in  action  by  evaluating  "on-going"  instruction 
in.  the  classroom,  shop,  laboratory,  or  field.  Data  derived  from  observa- 
tion and  evaluation  are  used  to  judge  the  adequacy  of  system  components 
and  to  make  modifications  where  required.  Chapter  13  identifies  the 
components  cf  the  system  to  be  evaluated,  the  perspectives  to  be  repre- 
sented in  the  evaluation,  pitfalls  to  avoid,  and  the  procedures  to  be 
followed  by  evaluators. 

14.  Analyse  and  Use  Test  Results.  Criterion  test  results  provide 
another  means  for  evaluating  the  adequacy  of  the  instructional  system. 

We  11 -construe ted  tests  provide  an  excellent  means  of  quality  control. 

If  student  performance  on  the  teBt  indicates  mastery  of  the  behaviors 
which  were  the  objectives  of  the  syotem,  the  system  is  an  effective  one. 

In  many  cases,  the  results  of  the  administration  of  all  criterion  measures 
must  be  subjected  to  a complete  and  detailed  statistical  analysis,  with 
the  resulting  statistics  being  reviewed  to  determine  whether  the  objec- 
tives of  the  instruction  have  been  achieved,  and  specifically  where,  if 
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applicable,,  the  system  requires  revision.  Chapter  14  describes  the  uses 
to  which  test  results  should  be  put,  identifies  the  types  of  statistics 
which  should  be  derived,  and  prescribes  procedures  for  the  analysis  and 
use  of  test  results. 


15.  Follow-up  Graduates.  The  real  proof  of  the  effectiveness  of 
an  instructional  system  is  the  quality  of  the  graduates1  job  performance 
in  the  field.  Therefore,  the  final  quality  control  point  in  the  system 
is  based  on  the  collection  and  analysis  of  objective  data  regarding  the 
on-the-job  performance  of  graduates.  Using  procedures  similar  to  those 
used  in  performing  job  analysis,  teams  must  be  sent  to  field  units  to 
evaluate  the  performance  of  men  trained  under  the  system.  The  focal 
point  of  the  followup  is  the  quality  of  the  performance  of  the  graduate 
as  evaluated  by  team  members,  the  job  Incumbents,  their  immediate  super- 
visors, other  supervisory  personnel,  and  the  unit  commander.  Data 
derived  from  these  followup  visits  are  used  to  study  the  adequacy  of  the 
system  and  as  a basis  for  system  modifications.  Chapter  15  describes 
the  objectives  of  the  followup  process,  uses  of  followup  data,  and  pro- 
cedures for  the  conduct  of  followup. 
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CHAPTER  1 

COLLECTING  JOB  DATA 

A.  INTRODUCTION 


1.  Definition.  Job  analysis  involves  the  collection,  processing, 
and  interpretation  of  data  concerning  the  work  performed  by  personnel 
occupying  those  military  positions  requiring  the  performance,  or  direct 
technical  supervision  of  performance,  of  a military  occupational  spe- 
cialty (MOS).  The  process  of  job  analysis  consists  of  a sequence  of 
tested  procedures  designed  to  accomplish  the  following: 

a.  Collect,  record,  analyze,  and  interpret  the  duties  and 
tasks  performed  by  military  personnel  in  specific  M05. 

b.  Describe  the  environmental  factors  surrounding  the  per- 
formance of  these  duties  and  tasks. 

c.  Identify  the  skills,  knowledges,  and  abilities  required  to 
perform  the  duties  and  tasks. 

d.  Determine  acceptable  standards  for  the  performance  of 
duties  and  tasks. 

2.  Objectives . The  objectives  of  job  analysis  are  as  follows: 

a.  To  provide  the  HQ,  US  Army  Security  Agency  staff  with  the 
amount  and  kind  of  information  needed  to  carry  out  functions  which 
involve  jobs  and  job  incumbents;  e.g,,  recruiting,  selection,  classifica- 
tion, training,  assignment,  etc. 

b.  To  provide  the  US  Amy  Security  Agency  Training  Center  and 
School  staff  and  faculty  with  detailed  information  about  each  job: 
what  it  consists  of,  how  and  why  it  is  performed,  how  it  relates  to 
other  jobs,  the  conditions  under  which  it  is  performed,  the  standards  of 
acceptable  performance,  the  frequency  and  criticality  of  specific  tasks, 
and  the  equipment  and  materials  used.  These  data  are  used  in  deter- 
mining the  objectives,  content,  sequence,  emphasis,  and  means  of  con- 
ducting and  evaluating  training  programs. 

3.  Importance . Job  analysis  is  the  first  and  the  most  critical 
atep  in  the  development  of  an  instructional  system.  The  data  collected 
by  job  analysis  teams  provide  the  foundation  for  the  system.  Regardless 
of  how  well  the  subsequent  steps  are  carried  out,  if  job  analysis  data 
are  not  valid  and  reliable,  the  resulting  system  will  fail  to  produce 
personnel  who  are  able-  to  perform  their  duties  at  an  acceptable  level. 

4.  The  Need  for  Command  Coordination,  Supervision,  and  Control. 
Although  job  data  are  collected  at  the  lowest  level  of  organization  (the 
operator,  repairman,  or  supervisor),  the  procedures  used  must  be  coordi- 
nated and  controlled  at  a high  level  of  command.  If  this  is  not  done, 
the  training  program  will  reflect  "what  exists"  and  not  "what  should  be." 


If  a school  par forks  job  analyaia  and  usee  the  data  to  construct  a 
training  program  without  an  adequate  screening  or  review,  there  is  a 
serious  risk  of  reflecting  '’field  expedients"  or  "stop-gap"  measures  in 
the  training  system.  Job  data  must,  therefore,  be  collected  under  the 
supervision  and  control  of  the  headquarters  staff,  and  the  resulting 
conclusions  must  be  reviewed  by  the  staff.  When  this  is  done,  the  data 
with  which  personnel  work  in  developing  instructional  systems  will  be 
officially  sanctionea.  Of  equal  importance  is  the  fact  that  this  pro- 
cedure enables  coordination  of  such  related  actions  as  recruitment, 
selection  and  assignment,  equipment  research,  development,  and  procure- 
ment. 

5.  Authority.  The  Command  Job  Analysis  System  is  currently 
operated  under  the  staff  supervision  of  the  Deputy  Chief  of  Staff  for 
Personnel,  HQ,  USASA.  This  system  calls  for  representatives  of  the 
HQ  USASA  Deputy  Chiefs  of  Staff  for  personnel,  Force  Department, 
Logistics,  Research  and  Development  end  representatives  of  the  USASATC&S 
to  serve  as  members  of  jot  analysis  teams.  Following  consolidation  and 
analysis  of  job  data,  a report  is  staffed  through  KQ,  USASA  and,  where 
necessary,  comments  reflecting  the  headquarters'  requirements  ere  added. 
These  comments  ere  used  to  Justify  modifications  of  field-generated  job 
analysis  date. 


B.  PHASES  IN  JOB  ANALYSIS 


1.  Planning  and  Training.  Prior  to  the  actual  collection  of  Job 
data  at  field  units,  a great  deal  of  preliminary  planning  and  training 
must  be  done.  During  this  planning  and  training  phase,  the  functional 
area  to  be  analysed  is  selected,  members  of  the  job  analysis  teams  are 
chosen,  administrative  arrangements  are  made,  fiscal  approvals  are 
obtained,  job  analysts  are  trained,  and  data  collection  forms  are  devel- 
oped. 


2.  Collecting  Job  Data.  During  this  phase,  job  analysis  teams 
visit  selected  field  units.  By  means  of  interview  aval  observation  of 
job  incumbents,  and  interviews  with  supervisory  personnel,  the  teams 
collect  the  data  which  describe  the  Job,  the  conditions  under  which  it 
is  performed,  and  the  standards  of  acceptable  performance. 

3.  Consolidating  Job  Data.  Upon  completion  of  visits  to  field 
units  end  return  to  HQ,  USASA,  job  analysts  teams  begin  the  third  phase, 
the  consolidation  of  data.  During  this  phase,  the  individual  job  anal- 
ysis schedules  completed  in  the  field  are  consolidated  irto  one  report 
which  describes  the  division  of  jobs,  duties,  and  tasks  within  the 
functional  area  studied. 
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4.  Analyzing  and  Reporting.  In  this  last  phase,  the  consolidated 
Job  analysis  report,  together  with  the  feeder  reports,  is  analyzed  to 
determine  requirement*  for  new  jobs,  revised  job  descriptions,  new 
training  systems,  changes  to  existing  training  programs,  equipment 
requirements,  etc.  These  requirements  are  used  as  a basis  for  develop- 
ing recommendations,  which,  when  appended  to  the  job  analysis  report 
and  approved,  become  directives. 

C.  THE  STRUCTURE  OF  JOB  DATA 

1.  Basic  Structure  of  Jobs.  There  is  a basic  structure  which  is 
common  to  all  jobs.  This  fact  makes  it  possible  to  develop  and  apply  a 
standardized  method  of  studying  jobs.  The  term  "job"  is  applied  to  a 
particular  unit  in  the  hierarchy  of  work  done  to  produce  goods  and  ser- 
vices. The  nature  of  the  work  hierarchy  is  described  as  follows:  "The 
work  hierarchy  has  as  its  base  the  work  operations  a single  worker  per- 
forms in  doing  a portion  of  his  job;  the  discrete  motions,  mental  pro- 
cesses and  movements.  Its  upper  limit  is  formed  by  the  work  operations 
accomplished  by  groups  of  individuals  combined  into  organizations. 
Various  names  are  given  to  the  units  that  compose  this  range  of  work 
operations  for  the  production  of  goods  and  services.  Significant  for 
an  understanding  of  basic  job  structure  and  job  analysis  are  the  follow- 
ing terms:  position,  job, duty,  task,  and  element.  Figure  1 shows  the 
interrelationships  between  job,  duties,  tasks,  and  elements. 


Figure  1.  Interrelationships  of  Job,  duties,  tasks,  and  elements. 


^IPY-Joh  Analysi8_.Manual  l,_SOB  Report  1-60-QR  (Department  of  the  Army, 
March  1966),  p.  4. 
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2.  Definition*  of  Job  Analyte  Terms. 

a.  Position.  A position  is  a grouping  of  duties  and  respon- 
sibilities which  comprise  the  principal  assignment  of  one  person.  It  is 
the  basic  functional  unit  of  an  organisation.  A position  has  the  fol- 
lowing characteristics: 

(1)  It  has  a definite  purpose  and  scope. 

(2)  It  requires  the  full-time  service  of  one  individual. 

(3)  It  involves  work  which  usually  utilises  related 
skills,  knowledges,  and  abilities. 

(4)  It  is  usually  officially  established  and  formally 
recognised  in  a manning  table. 

(5)  It  exists,  whether  occupied  or  vacant.* 

b.  Job . The  duties  and  tasks  performed  by  one  man  constitute 
his  job.  The  term  job  is  applied  to  a group  of  identical  positions; 
that  is,  if  identical  duties  and  tasks  are  performed  by  several  individ- 
uals, they  all  hold  the  same  job.  "A  job  is  the  unit  with  which  the  per- 
sonnel transactions  of  selection,  training,  classification,  and  assign- 
ment are  usually  carried  out.  In  the  Army,  such  groupings  or  jobs  are 
defined  as  Military  Occupational  Specialties  (MOS).  These  MOS,  by  iden- 
tifying Job  requirements  and  Individual  qualifications,  facilitating 
distribution  of  personnel,  by  providing  for  broadly  trained  replacements, 
and  by  reducing  the  training  time  through  facilitating  more  accurate 
estimates  of  force  requirements,  form  the  occupational  basis  of  the 
Army’s  personnel  management  system.  In  fact,  it  may  be  considered  the 
point  where  the  personnel  management  system  begins. "2 

c.  Duty-  A Job  is  made  up  of  one  or  more  duties.  A duty  is 
a large  segment  of  the  work  done  by  one  individual.  It  is  a major  sub- 
division of  the  work  performed  by  one  man.  The  following  are  distinguish- 
ing characteristics  of  a duty: 

(1)  It  is  recognised,  usually,  as  being  one  of  the  posi- 
tion (Job)  incumbent's  principal  responsibilities. 

(2)  It  occupies  a reasonable  portion  of  the  position  (Job) 
Incumbent's  worktime. 

(3)  It  occurs  with  reasonable  frequency  in  the  work  cycle. 

(4)  It  involves  work  operations  which  use  closely  related 
skills,  knowledges,  and  abilities. 

"It  is  performed  for  some  purpose,  by  some  method,  according  to  some 
standard  with  respect  to  speed,  accuracy,  quality,  or  quantity,  fltls 
standard  may  be  provided  by  the  position  (Job)  it»c>-  bent  himself  through 
trial  and  error  or  as  a result  of  experience;  it  msy  be  furnished  to  the 
lncvmbent  by  his  superior  in  the  form  of  oral,  written,  or  graphic 
instructions;  or,  it  may  exist  in  the  form  of  directives,  published  oper- 
ating procedures,  or  similar  media.  Duties  may  be  considered  as  major 
or  minor,  depending  upon  the  extent  to  which  they  establish  demands  for 
skills,  knowledges,  aptitudes,  physical  capacities,  and  personal  traits, 
and  upon  the  percentage  of  total  worktime  involved  in  their  performance. 

A duty,  major  or  minor,  has  one  or  more  of  the  following  characteristics: 


(1)  It  is  a significant  <’<  terssinant  for  initial  assign- 
msnt  to  tha  position; 

(2)  It  is  a significant  dotenoinant  of  pre-asslgnasnt  or 
post -assignment  train  •<>*; 

(3)  It  <a  j>igni£ic.  nt  in  the  determination  of  qualifica- 
tion required  to  perte  m iu  the  p -*tttion."^ 

d.  Task.  A task  is  u unit  of  work  activity  which  forms  a 
consistent  and  significant  part  of  « duty.  Hie  tasks  which  constitute  a 
Job  are  not  homogeneous  units  of  behavior;  they  are  logically  differenti- 
ated segments  of  work  activity.  A task,  then  has  the  same  relationship 
to  a duty  as  a duty  has  to  a job.  "Bach  duty  is  made  up  of  one  or  more 
tasks.  A task  is  one  of  the  work  operations  that  constitutes  a logical 
and  necessary  step  in  the  performance  of  a duty.  It  is  the  work  unit 
that  deals  with  the  methods  and  procedures  and  techniques  by  which 
duties  are  carried  out. "2  Bach  task  has  the  following  characteristics: 

(1)  It  occupies  a reasonable  portion  of  the  vorktime 
spent  in  performing  a duty. 

(2)  It  occurs  with  reasonable  frequency  in  the  work  cycle 

of  a duty. 

(3)  It  involves  very  closely  related  skills,  knowledges, 
and  abilities. 

(4)  It  is  performed  according  to  some  standard. 

a.  llesssmt.  The  element  is  the  most  detailed  level  of  work 
activity  described  in  Army  job  analyses.  Tasks  are  made  up  of  elements. 
These  are  the  smallest  steps  into  which  it  is  practicable  to  subdivide 
any  work  operation  without  analysing  separate  motions,  movements,  and 
mental  processes  involved.  An  element  is  a meaningful  and  useful  group- 
ing of  these  basic  work  units.  It  is  the  work  unit  that  deals  with  the 
details  of  how  the  methods,  procedures,  and  techniques  involved  in  a 
task  are  carried  out. 

3.  Form  to  be  Used  in  Collecting  Job  Data.  Data  collected  to 
describe  the  Jobs,  duties,  tasks,  and  elements  of  positions  for  which 
School  training  must  be  conducted  must  describe  all  aspects  of  the  Job. 

The  most  complete  and  meaningful  description  of  a job  is  a state- 
ment which  Identifies  the  basic  behavior  required  of  the  job  Incumbent, 
the  conditions  under  which  ha  will  perform,  and  the  standard  or  criterion 
of  acceptable  performance.  Data  reported  in  this  form  without  further 
treatment  are  Immediately  usable  in  establishing  objectives  for  a train- 
ing system. 

The  following  format  is  therefore  advocated  for  reporting  job, 
duty,  task,  and  element  descriptions: 

"Behavior;  The  behavior  should  be  a statement  of  what  the  men 
does,  or  must  do.  This  will  usually  be  something  that  you  can  see  the 
man  to  The  statement  of  the  behavior  begins  with  a verb.  It  is  an 
actio  Such  words  as  COPIES,  ADJUSTS,  SOLDSRS,  SUBSTITUTES,  BTC.,  will 
star,  a statement  of  behavior. 


ljbid.,  P-  5-6 
fold.,  p.  6 
3Loc.cit. 


Condition:  the  condition  outlines  the  factors  which  directly 
affect  the  aan'e  performance.  It  la  a statement  of  what  the  tsan  is 
alven  to  do  the  job,  or  what  he  Is  not  Riven  to  do  the  job.  The  condi- 
tion will  list  the  tools,  equipment,  degree  of  supervision,  and  assist- 
ance which  the  man  will  or  will  not  have  to  do  the  job. 

Criterion:  Ibe  criterion  will  list  the  index  of  acceptability 
which  is  used  to  judge  the  quality  of  the  man's  performance.  This  sec- 
tion should  describe  the  criterion  of  acceptability  in  terms  of 
QUALITY,  l.e.,  accuracy,  tolerance,  completeness,  format,  sequence, 
clarity,  neatness,  and  number  of  errors;  QUANTITY,  l.e.,  number  of 
work  units  produced  per  time  unit,  and  number  of  work  units  required 
by  the  nature  of  the  job;  and  TIME,  l.e.,  speed  of  performance. 

These  criteria  must  be  objectively  justified  by  listing  an  Army  Regula- 
tion (AR),  Technical  Manual  (TM),  etc.,  which  references  the  criterion. 
If  one  does  not  exist,  the  source  of  information  must  be  listed,  e.g., 
consensus,  individual  knowledge,  etc."* 


D.  PROCEDURES 


1.  Planning  and  Training. 

a.  Selecting  Job  Analysts.  Job  analyses  will  be  performed 
only  by  carefully  selected  military  and  civilian  personnel  who  have 
received  training  in  the  conduct  of  job  analysis.  Team  members  may  be 
drawn  from  any  staff  element  of  HQ,  USASA  and  any  element  of  the 
USASATC&S. 

(1)  HQ,  USASA  representatives  are  selected  by  DCSPER  from 
nominees  submitted  by  other  staff  elements. 

(2)  USASATC&S  representatives  are  selected  by  the 
Assistant  Commandant  from  nominees  submitted  by  academic  and  staff  ele- 
ments. 

b.  Selecting  Specific  Units  for  Survey.  Chief,  Evaluation 
Unit,  in  coordination  with  HQ,  USASA  and  the  USASATC&S  staff  elements, 
will  select  specific  units  for  survey  which: 

(1)  Have  Table  of  Distribution-Augmentation  (TDA)  spaces 
authorised  for  the  functional  areas  and  MOS  to  be  analysed. 

(2)  Have  a minimum  of  five  job  incumbents  who  match  selec- 
tion criteria  identified  in  paragraph  2 c of  this  section. 

(3)  Are  representative  of  all  "type"  user  unite  and  all 
echelons  of  command. 

(4)  Are  representative  in  terms  of  the  major  missions. 

(5)  Reflect  "typical"  Job  requirements  in  the  MOS  to  be 

studied. 

(6)  Are  geographically  and  environmentally  representative. 


*C,  L.  John  lAgere,  USASA  Coemand  Job  Analysis  System.  Job  Analysis  Hand- 
book and  Guide.  2d  ed,  (Fort  Devene,  Mass.,  1966),  p.  15. 
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c.  Hiking  Administrative  Artangema n».  Chief,  Evaluation 
Unit  will  coordinate  a<ininietrativa  arrangements  to  ineiuda: 

(1)  Funding. 

(2)  Preparation  of  ordare. 

(3)  Obtaining  paaeporta  and  viaaa. 

(4)  Innoculationa. 

(5)  Travel  reearvationa. 

(6)  Notification  of  unite  to  be  vieited  of  purpose,  tine, 

and  duration. 

d.  Training  Job  Analyaia  Tams*. 

(1)  Chief,  Evaluation  Unit  will  present  a formal  course 
of  instruction  in  the  conduct  of  job  analyses  as  required.  Annex  A to 
this  chapter  contains  an  outline  program  of  instruction  for  training 
job  analysts. 

(2)  As  a part  of  their  training  program,  job  analysis 
team  members  will: 

(a)  Study  documents  relating  to  the  mission,  organ- 
isation, and  capabilities  of  units  to  be  visited. 

(b)  Review  equipment  authorizations  for  units  to  be 

visited. 

(c)  Study  current  Army  regulations  concerning  Job 
descriptions  of  MOS  to  be  analyzed. 

(d)  Review  existing  job  analyses,  if  available. 

(•)  Prepare  prestructured  data  collection  forms. 

(f)  Prepare  and  rehearse  standard  briefings  for: 

1,.  The  theater  commander. 

2 . Unit  commanders . 

3.  Supervisory  personnel. 

4.  Job  incisnbents. 

(g)  Develop  a schedule  for  the  conduct  of  the  anal- 
yses. A typical  schedule  is  attached  as  Annex  B to  this  chapter. 

2.  Collecting  Job  Data. 

».  Preliminary  Activities.  Upon  arrival  at  each  unit,  the 
Job  analysis  team  chief  will: 

(1)  Brief  the  unit  commander  and  his  staff  on  the  pur- 
poses, procedures,  and  requirements  of  the  team. 

(2)  Request  a coemiand  mission  briefing  and  tour  of  facil- 
ities. 

b.  Unit  Analysis.  Before  Job  date  ere  collected,  unit  analy- 
sis must  be  performed  by  Job  analysis  teem  members  to  determine  what 
duties  and  tasks  are  performed  in  the  unit.  This  analysis  does  not  deal 
with  MOS  codes  or  Job  titles;  rather,  it  is  concerned  with  analysis  of 
a functional  area;  i.s.,  maintenance,  collection,  or  analysis.  The  ob- 
jective of  the  analysis  is  to  list,  analyze,  and  group  the  mission  tasks 
of  the  unit  to  determine  the  configuration  of  Jobs  which  exists.  (A 
•••pis  unit  analysis  form  is  at  annex  C.) 
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c.  Salaction  and  Briefing  of  Inf  rvlewtes:  Team  members  will: 

(1)  Brief  the  ataff  on  rsquiremants  end  requut  that  nom- 
inatioaa  be  made  for  the  interview  and  observation  of  incumbent a who: 

(a)  Perform  dutiea  typical  of  the  functional  area 

identified. 

(b)  Perform  dutiea  with  average  satisfactory  profi- 
ciency . 

(c)  Have  been  working  in  the  MOS  for  a long  enough 
period  to  be  adjusted  to  it,  but  not  for  such  a long  period  of  time  than 
their  awareness  of  the  differences  between  various  steps  has  been  lost. 

(d)  Do  not  possess  unusually  extensive  or  limited 
educational  backgrounds,  or  unusually  varied  or  limited  prior  work 
experience. 

(2)  Review  records  of  nominees  and  select  personnel  for 
interview  and  observation. 

d.  Preparation  of  Interviewees.  Tesm  members  will: 

(1)  Brief  job  incumbents  on  the  purpose  and  procedures  of 

Job  analysis. 

(2)  Set  up  a schedule  of  Interviews  and  observations. 

(3)  Distribute  equipment  lists  for  completion  by  incum- 
bents. 

e.  Interviewing.  Observing,  and  Recording  Data. 

(1)  Interviewing.  In  conducting  interviews  with  job 
lncwbents,  team  members  will: 

(a)  Establish  rapport  before  attempting  to  collect 

data. 

(b)  Let  the  Job  incumbent  describe  his  duties  (don't 
tell  him  what  he  does). 

(c)  Get  at  the  specifics  of  Job  performance. 

(d)  Record  data  carefully. 

(a)  End  the  interview  when  the  Incumbent  can  no 
longer  give  pertinent  and  useful  information. 

(2)  Observing.  In  observing  the  job  Incumbent  perform 
the  duties  and  tasks  of  his  job,  team  membars  will: 

(a)  Observe  long  enough  to  witness  performance  of 

all  major  duties. 

(b)  Avoid  getting  in  the  way. 

(c)  Ask  questions  only  when  necessary. 

(d)  Hake  careful  notes  of  observation  including 
environmental  conditions  and  contingencies. 

(3)  Recording . learn  membars  will  record  data  on  the  pre- 
structured Job  Analysis  Report  form  as  follows: 

a.  part  I - Identifying  Information.  (Sample  is 
attached  as  annex  D. ) All  information  required  to  modify  a particular 
Job  analysis  report,  to  fully  identify  the  unit  in  which  the  Job  incum- 
bent works,  and  to  present  background  information  about  the  man  himself 
will  be  recorded  in  this  part  of  the  report.  One  copy  will  be  completed 
for  each  job  incumbent  Interviewed.  Information  will  be  recorded  ea 
follows: 
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1.  The  Approval*  aectlon  of  the  Job  Analysis 
#.Bnrt  wlll  b.  filled  out  after  the  report  haa  bean  completed.  The 
aoor ova 1 a are  an  irapor tant  link  in  establishing  th.  fact  that  these  Job 

section  "pin  down"  the’ectndl  MOS  cod.  end  title  of  th.  duty  poeltlon 
being  .;.ly«.d.  Sen.  g.n.c.l  till.,  -ill  b.  n..d  »h.n  th.  un  ^ 

1.  aed..  All  Identifying  lnforoetlon  must  b.  offlclel  «nc  r 
la  actually  authorised  at  that  station.  The  wording  title  is  y 
Important  because  it  may  reflect  the  functional  work  area  with  which  t 
man  haa  been  identified.  The  geographical  location  of  the  unit  i*  1 
important.  If  the  official  unit  designation  does  not  reflect  * detach 
aent  atructure.  and  Job  data  are  being  collected  at  » remote  sito, 
actual  location  will  serve  to  make  the  latter  point  clear. 

3.  The  TOA  information  must  be  collected  fr«n  ^ 

the  ataff  of  the  aection’being  visited.  Don't  count  on  each  individual  a 
knowing  Just  which  TOA  hia  unit  is  using,  dec  this  information JV°* 
the  officials  of  the  station.  When  analysing  the  collected  data, 
will  be  necesaarv  to  check  all  TIU  for  additional  information  to  cor- 
rectly identify  each  individual  in  the  light  of  the  particular  TllA  if 
mhich  th.  incumbent  L a P«t.  lnfonMtiou  mav  be 

collected  during  the  coiaand  briefing  and  tour.  This  information  should 
be  about  the  subdivision  visited.  The  station-wide  data  will  be  io 
lected  by  the  team  chief.  This  information  will  be  difficult  to  collect 
during  ’'he  briefing  and  tour,  so  all  data  must  be  validated  later  . 

Nakalt  aa  accurate  as  possible  bv  having  unit  personnel  when  inter - 
viawad  and  obaerved,  add  to  it.  correct  It,  and  amplify  »»hat  has  been 
collected,  Th#  organisational  charts  should  Include  the  name  if  the 
person  filling  the  position  as  well  as  the  name  of  the  position;  e.g., 

Hilntenanee  Officer,  Captain  Jones;  NCOIC,  SOT  Smith. 

.S.  The  information  describing  the  supervision 

which  the  individual  receives,  the  supervision  which  he  exercises, 
should  always  be  validated  with  the  individual's  supervisor.  The  degree 
to  which  people  understand,  or  save  willing  to  admit,  the  supervisory 
structure  of  which  they  are  a part,  may  be  surprising-  When  describing 
supervision  be  sure  to  use  the  levels  as  designated  in  the  standard  terms. 

6,  The  job  analyst  should  get  a copy  of  pages 
1 2 and  3 oi  each  incumbent's  IX\  Form  20.  If  this  cannot  be  accom- 

plished, the  following  information  should  be  extracted  from  the  incum- 

b#nt‘  *,  item  23  - HOS  Kvaluation  Score. 

b.  Item  24  - Aptitude  Test  Scores. 

c.  Item  25  - Other  test  Scores. 

d.  Item  27  - Military  Education. 

e.  Ittta  28  - Specialised  Training. 
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f.  Item  30  • Language*. 

&.  Item  32  - Civilian  Education. 

h.  Item  34  - Civil  Occupation. 

I.  Item  38  - Aealgnaente. 

(b)  Part  II  - Detaila  of  Dutlaa  and  Taaka.  (Sample 
la  attached  aa  annex  E.)  Specific  directlona  for  completing  thia  form 
are  ae  follow*: 

1_.  Activities  of  the  visited  connand  which  are 
noat  critical  and  time  consuming  have  been  identified  during  the  unit 
analyala;  and  nominees  from  the  various  levela,  i.e.,  basic,  intermediate, 
and  advanced,  and  aupervisory  activity  within  these  functional  areas, 
have  been  proposed  for  interview  and  observation.  Therefore,  the  men 
selected  for  Interview  will  not  be  complete  "unknowns."  The  first  task 
with  each  interviewee  trill  be  to  determine  which  major  duties  he  per* 
forms,  i.e.,  operates,  maintains,  processes,  reports,  or  supervises. 

When  it  has  been  determined  which  of  the  duties  he  is  involved  with, 
the  duty  outline  is  used  to  determine  which  tasks  within  the  duties  he 
la  actually  working  with.  During  thia  process,  same  tasks  will  be 
eliminated  and  some  added . The  duty  outlines  of  the  work  activities 
for  which  he  is  responsible  will  now  be  an  accurate  list  of  the  teaks 
performed  within  that  duty. 

2.  Use  these  duty  outlines  to  collate  a job 
analysis  report  form  for  the  individual  from  the  pages  in  the  kit  of 
forms.  For  each  duty  which  is  the  responsibility  of  the  selected  Job 
incumbent,  collate  the  following:  (This  procedure  applies  to  part  II 
or  the  job  analysis  report.) 

a.  Cover  page  which  identifies  the  job 

Incumbent  and  job  analyst. 

b.  A Duty  Outline  Sheet  for  each  duty. 

Each  duty  should  be  separated.  The  duty  outline  Included  with  the 
Individual's  job  analysis  report  should  be  the  one  previously  used  to 
Inventory  the  tasks  performed  by  that  individual. 

c.  A Duty  Behavior  Statement  Sheet  for  the 
sea*  duty  as  indicated  in  the  duty  outline  should  be  included.  The 
form  should  be  completed  very  carefully.  The  condition  and  the  cri- 
terion sections  must  be  as  complete  and  objective  as  possible.  Check 
the  behavior  section  to  insure  that  the  prestructured  portion  is  accu- 
rate and  complete.  (See  annex  H for  importance  code  and  supervision 
standards.) 

d.  A Duty  Continuation  Sheet  should  be 
included  for  each  duty.  The  continuation  sheet  will  identify  other 
pieces  of  equipment  on  which  this  duty  activity  is  performed  by  the 
seme  Job  incumbent.  This  sheet  will  also  list  any  changes  required  in 
the  etatemante  of  the  condition  and  cha  criterion  to  sutite  them  applica- 
ble to  the  different  items  of  equipment. 

e.  A Teak  Behavior  Sheet  will  be  prepared 
for  each  of  the  taeke  which  have  been  checked  or  added  to  the  Duty  Out- 
line Sheet.  Theee  Teak  Behavior  Shaeta  trill  ba  completed  with  the  same 
attention  to  detail  given  the  duty  behavior  statement.  Check  the  pre- 
structured behavior  for  accuracy. 
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f . An  Elemant  Sheet  for  each  teak  should 
be  attached  when  required.  Ihla  list  swat  be  a clear,  concise  picture 
of  the  behaviors  necessary  to  perform  the  eleaents  of  the  task.  It 
must  be  Included  if  the  conditions  or  criteria  need  additional  explana- 
tlon.  Additional  shaets  for  tasks  and  eleaents  should  also  be  added  if 
required . 

(c)  Part  III  - General  Information.  (Staple  la 
attached  as  annex  F.)  Part  111  has  spaces  for  definitions,  environ- 
mental conditions,  and  general  comments.  This  section  should  be  used 
to  "pin  down"  any  words  which  are  used  in  a different  manner  at  the 
station,  and  to  standardize  the  use  of  technical  terms.  When  a man  per- 
sists in  the  use  of  a word  which  does  not  correspond  to  the  list  of 
standard  terms,  this  word  oust  be  equated  to  the  standard  term.  This 

is  the  tone  of  part  III;  all  information  which  requires  explanation  or 
modification  must  be  included. 

Definitions.  Job  analysis  reports  contain 
many  references  to  technical  terminology  and  jargon  which  oust  be  under- 
stood in  order  to  properly  analyze  the  data  upon  return  from  tha  field. 
The  definition  saction  will  contain  the  axplanatlon  of  terma  which 
appear  in  the  Job  Analyeia  Report,  part  II. 

2.  Environment.  The  environment  within  which 
the  job  inembent  works  la  a very  important  variable  which  muat  be  con- 
sidered in  tha  overall  Job  analysis.  Environment  includes  the  physical 
setting,  physiological  factors,  nuisances,  the  mental  set,  and  any 
other  factors  which  are  variables  in  the  performance  of  the  Job.  The 
supervision  which  the  individual  receives,  or  gives,  must  also  be  con- 
sidered as  part  of  the  environment.  Although  this  factor  will  be  used 
to  complete  certain  parts  of  the  job  analysis  data  in  other  sections,  it 
la  alao  «n  environmental  item.  If  identification  of  "level"  by  numeri- 
cal symbol  does  not  fully  explain  the  Influence  of  supervision  upon  the 
individual,  it  oust  be  explained  here. 

3.  General  consents,  the  comments  which  the 
man,  his  supervisor,  or  the  staff  of  the  coroand  make  about  the  partic- 
ular position  which  the  job  incixabent  fills  should  be  listed  in  the 
general  comments  section,  this  information  Is  valuable,  but  is  usually 
subjective.  Although  It  is  desirable  to  give  the  interviewee,  and  his 
supervisors,  the  courtesy  of  recording  their  comments,  It  is  necessary 
to  insure  chat  the  content  of  the  Job  analysis  report  will  not  adversely 
influence  proper  interpretation  of  the  material.  The  General  Comments 
section  serves  this  purpose.  The  comments  of  lnctmbents  er*  recorded 
and  may  be  examined  later.  Thie  procedure  separates  subjective  comments 
from  scientifically  collected  Job  data. 

(d)  Parc  IV  - Equipment  Information.  (Sample  la 
attached  as  annex  G.)  Specific  procedures  for  completing  this  form 
follow: 

JL.  Distribute  the  list  to  the  job  lncuabents 
chosen  for  interview  and  make  appointments  for  Interview  end  observation. 
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2_.  Direct  the  job  incumbents  to  review  the  list 
with  respect  to  their  own  job  activities,  end  to  indicete  those  pieces 
of  equipsmnt  with  which  they  ere  involved. 

2'  Direct  at  least  one  man  to  list  the  particu- 
lar  manual a or  references  which  the  station  usee  while  working  on  the 
indicated  equipment. 

4.  Request  each  man  to  add  any  equipment  with 
which  he  is  involved.  Direct  him  to  use  the  standard  nomenclature  and 
to  describe  any  modifications  which  change  the  basic  purpose,  or  capa- 
bility, of  the  equipment. 

5.  Instruct  the  man  to  put  hie  name,  rank,  and 
NOS  on  the  list  when  he  hee  finished  the  survey. 

6.  When  interviewing  the  man,  use  the  equipment 
list  to  establish  what  equipment  is  worked  with  during  the  performance 
of  the  various  work  activities. 

When  the  particular  interview  and  observa- 
tion have  been  completed,  the  equipment  list  will  be  attached  to  the 
completed  job  analysis  report  for  that  individual.  Be  sure  to  complete 
and  attach  the  part  IV  cover  sheet.  This  will  insure  that  the  equipment 
list  can  be  recovered  if  it  becomes  detached  from  the  other  parte  of  the 
report . 

8.  If  the  mission  and  organisation  of  a partic- 
ular station  seats  unique,  use  an  equipment  list  to  "pin  down"  all  of 
the  equipment  which  la  used  in  support  of  the  assigned  mission.  This 
list,  if  used,  will  be  labeled  clearly  as  a station-wide  list  so  that 
it  will  not  become  attached  to  an  individual  job  analysis  report. 

3.  Consolidation  Job  Data.  When  analysis  is  performed  for  an 
overseas  command , upon  return  to  the  continental  United  States,  Job 
analysis  teems  will  consolidate  individual  job  analysis  reports  into 
one  master  report. 

a.  Average  indices  describing  the  criticality  or  importance 
of  each  duty  and  task  will  be  derived. 

b.  The  frequency  of  activity  with  each  item  of  equipment  will 
be  determined. 

c.  Duties,  tasks,  tnd  elements  performed  will  be  consolidated, 
and  a statement  of  the  oven  11  Job,  in  terms  of  behavior,  conditions, 
and  criterion  will  be  developed. 

d.  tkities  not  considered  significant,  and  their  accompanying 
task  and  element  descriptions,  will  be  Hated  separately. 

4.  Analysing  and  Reporting. 

a.  Analysis.  The  date  in  the  consolidated  reports,  as  well 
as  in  the  individual  feeder  reports,  will  be  used  by  staff  elements  of 
HQ,  USA&A  and  the  USASATC&S  to  analyse  the  differences  which  exist  between 
whet  it  done  in  the  field,  end  what  is  provided  for  in  regulatory  con- 
trols and  programs.  Any  problems  which  exist,  or  which  could  exist, 
should  be  explained  by  this  comparison.  During  the  analysis,  the  base 
data  will  be  used  to  determine  what  should  be  done  in  the  light  of 
up-to-date  field  requirements  and  operations. 
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b.  Rigor  ting.  Racoranendaticm*  will  be  framed  to  implement 
either  en  oxpanded,  or  modified  existing  program,  or  ca  e recommended 
change  to  the  existing  program.  These  changes,  if  any,  will  be 
reflected  in  all  organizational  aliments  (i.a.,  Gi,  G2,  G3,  G4,  Combat 
Developments  Activity,  and  the  Sm  ooi)  which  influence  the  respective 
operation.  If  accepted,  these  changes,  or  codifications,  will  be 
installed  in  all  affected  ay sterna.  Following  staffing,  these  changes 
will  be  combined  with  the  basic  job  analysis  performance  requirements, 
end  when  finally  released,  the  end  product  will  be  an  up-to-date  and 
authoritative  statement.  Bach  staff  element  will  use  these  statements 
as  beee  data  to  guide  its  particular  activities.  The  School  and  other 
training  activities  will  use  the  job  performance  requirements  as  input 
to  the  development  of  instructional  systems. 


E.  REFERENCES 


1.  Army  .Tob  Analysis  Manual  I,  SOB  Report  No.  1-70-QR.  Systems 
Development  Branch,  Research  and  Development  Division,  The  Adjutant 
General’s  Office  Department  of  the  Army,  March  1960. 

2.  Eegare,  C.L.  John,  "SATA  Command  Job  Analysis  System,  Job 
Analysis  Handbook  and  GulcU,  2d  ea.,  Evaluation  Unit,  US  Army  Security 
Agency  Training  Center  and  School,  Fort  Devons,  Massachusetts,  January 
1966. 
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ANKER  A 


First  Day 


Second  Oay 


third  Day 


outline  program  op  instruction 
Cooaand  Job  Analysis  Teams 


Subject 

introduction,  Greeting*,  and  Ad*ic- 
istr stive  Hatters 

Mission  and  Functions  of  Job  Analysis 
Teams 

Overview  of  the  process  of  Job  Analysis 
The  preparation  Phase  of  Job  Analysis 
otevlev  and  Integration  of  learning 

Study  of  TDA‘e  of  Units  to  be  Visited 

preliminary  Activities  of  Teams  Upon 
Arrive,  at  Unit 

preparation  of  Briefings 

Review  of  Briefings 

Analysis  of  a Job 

Techniques  of  Interview 

Technique*  of  Observation 

Review  end  Integration 

Observation  Practical  toarciaa 

Introduction  to  Standard  Job  Analysis 
Forms 

Interview  precticel  Exercise 

Identification  of  functional  Areas  in 
Unit  Analysis 


Tims  Allocation 
(Houre) 
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Third  Day 
(cone) 


Fourth  Day 


Fifth 
Through 
Minth  Days 


' — y * ■ , 

f 

........  » * i 

ANNEX  A (cont) 

Subject  Tin*  Allocation 

(Hour*) 

Examination  of  Data  Collected  During  1 

Interview  and  Obaervation 

Presentation  of  Trip  Itinerary  1 

End  Product  Reports  1 

Format  of  Prestructured  Data-Gatharlng  1 

Fortes 

Prestructuring  Activities  6 

Complete  Prestructuring  of  Data*  35 

Gathering  Foma 
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ANNEX  B 


DAILY  SCHEDULE  FOR  CONDUCT  OF  COWAND  JOB  ANALYSIS  SYSTEM 

Note:  If  the  Command  Job  Analyaia  Teen  arrives  after 
noon  of  the  first  day,  then  the  second  actual 
day  at  a station  should  be  considered  as  the 
first  day. 

First  Day: 

1.  Command  Job  Analysis  Tsaa  Briefing  for  Unit  Commander 

2.  Coonand  Mission  Briefing  for  Job  Analysis  Teas 

3.  Tour  of  the  Facilities 

4.  Unit  Analysis  Interviews  with  Operations  Officer 

5.  Identification  of  Major  Work  Areas 

Second  Day: 

1.  Briefing  of  Maintenance  Staff  (including  conference  on  duties 
located  and  "laying  on"  interview  requirements) 

2.  Study  of  Nominee  Records 

3.  Selection  of  Job  Analysis  Incimbents 

4.  Study  of  Operations  Area  to  Identify  Environmental  Conditions 

jjf:  S.  Briefing  of  Job  Incumbents 

6.  Setup  of  Interviews 

| 7.  Distribution  of  Equipment  Lists  for  Completion  by  Incumbents 


r7?S,7?.!^  ‘,:'’t:  : .'.s\-  r>  •• 


ANNEX  B (cont) 


Third  Day: 

1.  Interview 

2.  Observation 

3.  Interview 

4.  Observation 

5.  Etc. 


Fourth  Day: 

1 . Interview 

2.  Observation 

3.  Interview 

4.  Observation 

5.  Etc, 

6.  Finalisation  of  Reports 

7.  Arrangements  for  Relntervlewa 


Last  Day: 

1.  Job  Incumbent  Reinterview 

2.  Job  Incumbent  Reobservation 

3.  Setup  of  Supervisor  Exit  Interview 

4.  Exit  Briefing 


■ nmtw «.» I 

I 
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ANNEX  C 

USASA  COMMAND  JOB  ANALYSIS  SYSTEM 
UNIT  ANALYSIS 


Official  Command  Designation  

Unit  Name  _ 

Geographic  Location  _______ 

Data  of  Viait  _____ 

Functional  Work  Area  Investigated 


Commander  _____________________________________________ 

Deputy  _ 

Executive  Officer  ________ ___________________ ______ 

Operations  Officer  _________ _______ _________ ___ ______ 

Job  Analysis  Tsam  Chief  ______________________________ 

Number  of  Job  Analysis  Reports  Completed  at  this  Station 

Current  TDA  Title 

No.  

Date  

Latest  Change  ___________________ 
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ANNEX  C (cont) 

MISSION  INFORMATION 

i.  Mission  of  the  station:  (If  possible  attach  a copy  of  the 
mission  briefing.) 

a.  Overall  description  of  the  mission:  (Including  national- 
ity of  target.) 


b.  Types  of  targets: 


c.  Types  of  positions  used  in  support  of  the  mission: 
(Include  the  mnber, ) 


d.  Category  of  positions: 

Category  A 

Category  B ___________ 

Category  C 

Category  D 
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ANNEX  C (coot) 

e.  Tasking  direction: 

(1)  Given. 


(2)  Received. 


f.  Special  "problem  areas"  mentioned  by  the  caomander  and 
his  staff: 
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ANNEX  C (cont) 
ORGANIZATIONAL  INFORMATION 


2.  Organization  of  the  Unit/Station:  Complete  the  organizational 
chart  with  the  tltlea  and  names  of  the  personnel  filling  the  jobs. 
Additional  blocks  should  be  added  as  required. 


ANNEX  C (cont) 
3.  Personnel  composition  of  ths  unit: 


4.  CJA  unit 


ANNEX  C (cont) 
guide: 


Miselon 
activity 
(Y  or  N) 

No.  of 

Personnel 

involved 

Percent 

of 

mission 

MOS  of 

personnel 

Involved 

■ 

I 
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ANNEX  D 


JOB  ANALYSIS  REPORT 


PART  I 


identifying  INFORMATION 


Station 


Job  Analyst 
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ANNEX  D (cont) 

USASA  COMMAND  JOB  ANALYSIS 


A.  Approvals: 

Job  Analyst  _________ ____________  Date 

OIC  NCOIC  

Trick  Chl«f  Room  Supv  


8.  Identifying  Information: 

1.  Name  Reek  Svc  No.  

2.  Position  Title: 

a.  

(Official  classification  code  and  MQS  title  - AR  611-202) 

b.  

Duty  MOS  (As  authorised  by  IDA) 

(Alternate  or  "working  title") 

3.  Unit  Designation  and  Location: 

a.  

(Official  designation  of  unit) 

b.  

(Geographic  location) 

c.  _____ _____ 

(Official  designation  of  subdivision) 

4.  Organisational  Information: 

a.  Mission  of  Job  Incumbent. 'a  Section: 

(l)  (Xerall  description  of  aisaion: 
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ANNEX  D (coot) 

(2)  Position  designations:  (equipment  configuration) 


b . Specific  Organization  of  Subdivision:  (Draw  organisational 
chart  and  insert  the  naans  of  personnel  filling  the  jobs.  Star  (*) 
tha  position  of  tha  individual  being  analysed.) 


ANNEX  D (cont) 


ANNEX  E 


JOB  ANALYSIS  REPORT 
PART  II 

DETAILS  OP  DUTIES,  TASKS,  AND  ELEMENTS 


Name  Rank  NOS 

Date  ....  Statioa 

Job  Analyst  . . 
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ANNEX  E (coat) 


OUTLINE  OF  Dffl 
12  TASKS 

DUTY  TITLE:  12  PROCESS 
TASK  TITLE: 

1201  Sc«n 

1202  Tranacribe/TranaUte 

1203  Synm*ri*e/Coaaolid*t* 

1204  Valid* to 

1205  Format 

1206  Oparata*  Froceaaing  Equipment 


ANNEX  E (cont) 

DUTY  BEHAVIOR  STATEMENT  SHEET 


fin- 

Percentage 

Actual 

DUTY 

TITLE:  12  PROCESS 

Yes 

No 

port- 

ance 

Time 

Time 

DUTY  BEHAVIOR:  Perform*  intermediate  processing  of  collected 

material. 


DUTY  CONDITION:  (Given) 

SUPERVISION: 

A 

B 

C 

D 

— — — 

TOOLS/MATERIALS: 


EQUIPMENT: 

REFERENCES: 


HOT  GIVEN: 


CRITERION: 

1.  Procedures  must  be  in  accordance  with  . 

2.  Work  activity  must  be  accoopliehed  in  . (minutes/hrs/days) 

3.  Work  product  mutt  be  in  accordance  with  specifications  outlined  in 


4. 

5. 
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ANNEX  E (cont) 
TASK  BEHAVIOR  SHEET 


In- 

Percentage 

Actual 

TASK 

TITLE:  1201  SCAN 

Yes 

NO 

port- 

ance 

Time 

Time 

TASK  BEHAVIOR:  Scans  collected  metexlel  for  items  of  importance. 


TASK  CONDITION:  (Given} 

SUPERVISION: 

A 

B 

C 

D 

TOOLS/MATERIALS: 


EQUIPHENT: 


REFERENCES: 


NOT  GIVEN: 


CRITERION: 

1.  Procedures  must  be  in  accordance  with  , __________ 

2.  Work  activity  must  be  accomplished  in  . (ainutes/hrs/days) 

3.  Work  product  must  be  in  accordance  with  specification*  outlined 


4. 

5. 
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IESSES 


1201  Son 


ANNEX  E (cont) 


RECORD  SHEET 


ANNEX  F 


JOB  ANALYSIS  REPORT 
PART  III 

GENERAL  INFORMATION 


Name  Rank HOS 

Date  . Station  __ 

Job  Analyat  — 
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ANNEX  7 (eeat) 
DEFINITIONS 


Llat  any  terms  which  the  job  incumbent  uaea  during  the  interview 
or  obaarvatlon  which  ahould  be  clarified  when  the  results  of  this  job 
analysis  are  read. 


ANNEX  7 (cant) 


Describe  the  environment  of  the 
ltiee  ere  described  in  this  report. 
ell  of  the  surrounding  fectors  which 
Job. 


job  Incumbent  whose  work  ectiv- 
This  description  should  Include 
influence  the  performence  of  the 


ANNEX  F (cont) 
GENERAL  COMBATS 


Record  all  contents  received  frcm  members  of  the  subdivision 
staff  tihich  are  related  to  the  job  activities  performed  by  the  job 
inctwbent.  Both  positive,  and  negative  comments  should  be  included. 
Wherever  possible,  collect  not  just  a complaint,  but  a recommended 
solution. 
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ANNEX  G 


JOB  analysis  report 
part  IV 

EQUIPMENT  INFORMATION 


Kane  . ___ ___________  Rank  _____ _____  HCS 

Bat*  . Station  . 

Job  Analyst  _____ _________ — 
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AH/TRD-20 

AN/APA-69  TH  11-5826-203-15 

AH/PHD-1  tM  H-677 

AM/TCC-7  (T«leph<mA  tensln*l)  TH  11-2139-10 

Atf/ASA-34  (Recording  set)  TM  11-5895-331-20 


ANNEX  H 


IMPORTANCE  COOES  AND  LEVELS  0”  SUPERVISION 

1.  Importance  Codes  for  Duty  Behavior  Statement  Sheet. * 

a.  importance  Code  I.  This  duty  is  not  recogaited  a#  one 
of  the  lncunbant’s  principal  responsibilities.  St  occupies  a minor 
portion  of  his  total  work  activity. 

b.  Importance  Code  2.  This  duty  is  recognized  as  one  of 
the  -incicabent's  principal  responsibilities.  It  occupies  a reasonably 
large  portion  of  the  incumbent's  total  work  time  and  occurs  with 
reasonable  frequency  in  the  Job  cycle. 

c.  Importance  Code  3.  This  duty  is  recognized  as  a princi- 
pal responsibility  of  the  job  incumbent,  occupies  a major  portion  of 
his  time,  and  occurs  frequently  during  the  work  cycle. 

Note:  The  percent  of  time  this  duty  (or  task)  occupies  in  a 
typical  work  cycle  is  determined  and  entered  in  the  appropriate  block. 
If  a work  cycle  takes  three  hours,  and  the  man  spends  one  hour  per- 
forming the  duty  (or  t&sk)  being  analyzed,  then  33-1/3TL  would  be 
entered  in  the  "Percentage  Time"  block.  Work  cycles  vary  considerably. 
For  this  reason,  the  actual  time  is  recorded  in  the  last  block.  This 
provides  a validity  index  for  the  "Percentage  Time"  section,  and  allows 
for  more  flexibility  in  the  treatment  and  consolidation  of  the  result- 
ant data. 


2.  Levels  of  Supervision? 

a.  Supervision  Level  A.  This  is  the  most  detailed  level  of 
supervision.  The  supervisor  provides  detailed  instructions  concerning 
which  work  activity  to  perform,  and  how  to  perform  it.  The  Job  incum- 
bent is  not  permitted  to  proceed  to  any  new  area  of  activity  until 
further  instructions  have  been  given,  ihe  supervisor  provides  all 
necessary  tools,  materials,  and  references,  or  specifies  which  will  be 
used  for  a given  Job.  The  job  incumbent  is  net  permitted  to  make  judg- 
ments concerning  additional  requirements  and  la  not  permitted  to  pro- 
ceed independently. 

b.  Supervision  Level  B.  This  Is  a less  detailed  level  of 
supervision  than  Level  A.  The  supervisor  provides  specific  tasking 
concerning  which  task  or  duty  to  perform,  but  depend*  upon  the  incum- 
bent to  determine  how  to  do  the  work.  The  Job  incumbent  selects  his 
own  tool*,  materials,  and  references  to  do  the  work.  The  supervisor 
Is  available  for  consultation  regarding  how  to  do  the  work. 

c.  Supervision  Level  c.  This  is  a broad,  permissf-  e level 
of  supervision,  the  supervisor  assigns  a Job  incismbenc  to  a broad 
area  of  work  activity  and  permits  the  individual  to  decide  which 


*Aroy  Job  Analysis  Hancal,  op,  cit«.  p.  28. 
‘C,  L.  John  Lagere,  on.  cit,.  p.  7. 
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specific  activity,  within  the  broad  area,  must  be  performed,  and  in 
which  priority  they  must  be  performed.  The  Job  incumbent  determines 
hoy  to  perform  these  activities  and  selects  his  own  tools,  materials, 
and  references  to  do  the  work.  The  supervisor  is  available  for  con- 
Hultation  regarding  which  job  to  do  and  hoj»  to  do  the  work. 

d.  Supervision  Level  D.  This  is  an  independent  level  of 
operation.  The  Job  incimbent  is  assigned  to  a broad,  all  encompassing 
area  of  functional  responsibility  and  must  determine  which  Jobs  must 
be  performed,  and  how  they  should  be  performed.  The  job  incumbent  is 
subject  to  routine  staff  and  regulatory  controls,  but  is  independently 
responsible  for  activity  within  his  functional  area.  The  reaponsibi- 
litieu  within  this  level  -will  usually  include  the  necessity  to  super- 
vise others. 
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CHAPTER  2 


INCORPORATING  OPERATIONAL  DEVELOPMENTS 

A.  INTRODUCTION 


1.  Purpoto.  A completed  Job  analysis  schedule  describes  the 
duties,  tasks,  and  elements  performed  by  Incumbents  of  an  MOS  at  the 
time  the  job  analysis  is  made.  For  this  reason,  a job  analysis  pre- 
sents a picture  of  a job  as  it  exists,  not  as  it  should  be  or  may 
become.  If  a training  program  is  based  exclusively  on  data  derived 
from  periodic  job  analyses,  it  may  include  instruction  that  will  be 
unnecessary  or  obsolete  by  the  time  the  student  is  assigned  to  the  job 
in  the  field.  Similarly,  the  training  will  not  Include  instruction  in 
new  duties  and  tasks  or  changes  in  equipment,  procedures,  or  techniques 
that  have  occurred  since  the  last  job  analysis  was  performed.  U\ere- 
fore,  in  addition  to  the  data  derived  from  Job  analysis,  careful  con- 
sideration must  be  given  to  the  probable  Impact  of  evolving  organisa- 
tional systems,  new  concepts  of  operation,  doctrinal  changes,  and  new 
equipment,  material,  and  techniques.  This  chapter  defines  responsi- 
bilities and  procedures  for  identifying,  collecting,  and  processing 
material  and  document*  relating  to  theso  changes  to  insure  that,  when 
appropriate,  they  are  incorporated  into  the  training  objectives  of  the 
MOS  effected. 

2.  Sources. 

e.  The  primary  sources  of  data  pertaining  to  operational 
developments  are  reports  of  cooibat  development  field  experiments,  com- 
bat development  studies,  staff  and  faculty  position  papers  and  memo- 
randum*, service  tests,  troop  tests,  and  user  tests.  In  addition, 
records,  reports,  and  plans  available  from  ASA  units  frequently  contain 
doctrinal  data  which  have  Implications  for  school  training. 

b.  Secondary  sources  of  data  pertaining  to  operational  devel- 
opments are  military  service  schools,  the  Signal  Corps,  the  Combat 
Development*  Command,  colleges,  universities,  and  technical  schools,  and 
other  nonprofit  educational  agencies  end  research  organisations.  In 
addition,  manufacturers  of  equipment  and  aids,  publishers  of  Instruc- 
tional materials,  and  distributors  of  equipment,  aids,  and  instructional 
materials  sometimes  provide  data  which  have  implications  for  school 
training. 


5.  Definitions. 

*.  Poo trine.  A compilation  of  the  principles,  policies,  tech- 
niques, end/or  procedures  by  which  the  Armed  Force*  or  aleosnts  thereof 
guide  their  actions.  It  is  derived  from  approved  developmental  concept*, 
experience,  or  theory,  and  represent*  the  best  available  thought  that 
can  be  defended  by  reason.  It  is  taught  authoritatively  aa  guidance  but 
requires  Judgment  in  application. 
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b.  Combat  Developments.  The  formulation  of  new  Array  doctrine, 
organisations,  materiel  objectives  and  requirements,  and  the  early  inte- 
gration of  the  resulting  products  into  the  Array. 

c.  Combat  Development  Field  Experiment.  A field  trial, 
usually  conducted  under  controlled  conditions,  designed  to  collect  data 
on  operations,  organisations,  and  material  for  use  in  developing  or 
evaluating  new  or  improved  operational  and  organisational  objectives  or 
concepts,  tactics,  techniques,  procedures,  qualitative  materiel  develop- 
ment objectives,  or  qualitative  materiel  requirements. 

d.  Combat  pevelopment  Study.  A study  directed  at  the  deter- 
mination of  new  or  improved  operational  and  organisational  objectives 
and  concepts,  tactics,  techniques,  procedures,  qualitative  materiel 
objectives,  or  qualitative  materiel  requirements, 

a,  Service  Test.  A test  of  an  item,  system,  materiel,  or 
technique  conducted  under  simulated  or  actual  operational  conditions  to 
determine  whether  the  specified  military  requirements  or  characteristics 
are  satisfied. 

f.  Troop  Test.  A test  conducted  in  the  field  for  the  purpose 
of  evaluating  operational  or  organisational  concepts,  doctrine,  tactics, 
and  techniques,  or  to  gain  further  information  on  materiel. 

g.  User  Test,  A test  performed  under  operational  or  simulated 
operational  conditions  to  determine  the  military  suitability  of  an  item. 


B.  PROCEDURES 


1.  Identifying  Developmental  Data.  The  Office  of  Training  Litera- 
ture will  identify  developmental  data  which  have  implications  for  train- 
ing, However,  all  academic  and  staff  elements  will  assist  in  the  loca- 
tion and  identification  of  new  developments  within  their  areas  of  inter- 
est. To  insure  that  developmental  or  doctrinal  material  receives  timely 
consideration  for  inclusion  in  school  training  programs,  tho  following 
procedures  will  be  followed: 

a.  The  Assistant  Commandant  will  provide  overall  supervision 
of  the  USASATC&S  response  to  those  elements  of  the  USASA  Developments 
Program  which  have  implications  for  school  training,  in  addition  to 
approving  all  changes  to  programs  of  instruction  (POI). 

b.  The  Technical  Consultant  will  provide  advice  and  assist- 
ance to  the  Director,  Office  of  Training  Literature  in  the  identifica- 
tion of  new  developments.  He  will  review  material  upon  request  of 
Director,  Office  of  Training  Literature. 

c.  The  Director,  Office  of  Training  Literature  will  establish 
the  necessary  internal  procedures  to  locate  and  obtain  developmental  and 
doctrinal  material  in  selected  publications  e.f  the  following  types: 

(1)  Depsrfctsnt  of  the  Ansy  official  and  unofficial  publi- 
cations. 

(2)  Dsp*rt»saGt  of  defense  publications. 


2-2 


(3)  Publication*  of  all  cryptologic  service*. 

(4)  Publication*  and  reports  produced  by  industrial  con- 
cern* in  connection  with  government  contract*. 

(5)  Research  report*  from  any  available  source. 

In  addition,  the  Office  of  Training  Literature  will  review  and  coordi- 
nate the  review  of  publications  and  document*  to  Identify  doctrinal  or 
developmental  data;  furnish  material  which  ha*  training  implications 
to  the  Chief,  Evaluation  Unit  for  information  and  action;  and  review 
lesson  plans,  training  aid*,  and  instructional  material  for  doctrinal 
accuracy.  When  necessary,  the  Office  of  Training  Literature  will  also 
furnish  material  which  may  require  change*  in  current  POI  to  the 
Assistant  Commandant;  Chief,  Evaluation  Unit;  and  the  Director  of 
Instruction. 

d.  The  Chief,  Evaluation  Unit  will  select  those  appropriate 
development*  to  be  incorporated  in  school  training,  and  recommend  to 
the  Assistant  Commandant,  in  coordination  with  Interested  staff  and 
faculty,  the  material  to  be  included  in  the  revised  POI  and  the  effec- 
tive date  of  the  change. 

e.  The  Director  of  Instruction  will  designate  reviewing 
officers  within  the  academic  elements  for  those  publications  referred 
to  his  office  for  review,  and  advise  the  Office  of  Training  Literature 
of  the  disposition  of  all  such  developmental  and  doctrinal  material. 

The  Office  of  Training  Literature  will  be  the  office  of  record  for  all 
developmental  and  doctrinal  material  received  or  developed  at  the  School. 

f.  Academic  and  staff  elements  will  be  constantly  alert  to 
identify  doctrinal  and  developmental  material  in  their  areas  of  interest. 
Some  sources  of  data  are; 

(1)  Technical  publications. 

(2)  Attendance  ot  meetings,  conferences,  exhibitions, 

and  seminars. 

(3)  Visits  to,  and  correspondence  with,  ASA  units. 

(4)  Participation  In  field  exercises. 

(5)  Reports  of  oversea  returnees. 

Academic  and  staff  elements  will  inform  the  Director,  Office  of  Train- 
ing Literature  of  doctrinal  or  developmental  changes  whan  such  material 
it  routed  directly  to  the  departments  concerned;  review  doctrinal  or 
developmental  material  received  from  the  Director  of  Instruction  and 
provide  comments  to  him,  and  to  the  Director,  Office  of  Training  Liter- 
ature; and  incorporate  doctrinal  and  developmental  material  into  appro- 
priate POI  as  directed  by  tho  Director  of  Instruction, 

2.  Preliminary  Review.  When  developmental  or  doctrinal  material 
has  been  identified,  the  following  procedures  will  be  followed: 

a.  If  identified  by  Office  of  Training  Literature  - 

(1)  At  least  one  copy  of  the  document  describing  the 
development  or  change  will  be  obtained  for  local  review. 
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(2)  A preliminary  review  and  evaluation  of  the  applica- 
bility of  the  material  will  be  conducted  by  the  Office  of  Training 
Literature. 

b.  If  identified  by  academic  or  staff  elements,  a copy  will 
be  forwarded  to  the  Office  of  Training  Literature  for  review. 

3.  Disposition  of  Material.  Where  preliminary  review  30  indi- 
cates, Office  of  Training  Literature  will: 

a.  Produce  or  obtain  additional  copies  of  the  material. 

b.  Distribute  copies  of  the  material  for  review  and  comment 
as  follows: 

(1)  Technical  Consultant  - 1 copy. 

(2)  The  Director,  Academic  Department  or  staff  element 
concerned  - 2 copies. 

c.  Forward,  upon  receipt  of  the  comments  of  the  Technical 
Consultant  and  the  Director,  Academic  Department  or  staff  element  con- 
cerned, one  copy  of  the  material,  together  with  the  comments  of  the 
reviewers,  to  Chief,  Evaluation  Unit. 

4.  Incorporating  New  Developments.  Chief,  Evaluation  Unit  will: 

a.  Review  the  documentary  material  and  the  comments  of  staff 
and  faculty  reviewers. 

b.  Apply  appropriate  selection  criteria  to  determine  whether 
the  development  should  be  incorporated  into  the  training  program.  (See 
chapter  3). 

c.  If  an  affirmative  decision  is  made,  develop  a list  of 
training  objectives  and  submit  to: 

(1)  The  Director,  Office  of  Training  Literature  for  a 
check  of  doctrinal  correctness. 

(2)  The  Director,  Academic  Department  concerned  for  a 
check  of  technical  accuracy. 

d.  Add  these  objectives  to  the  list  of  training  objectives 
derived  from  job  analysis. 

e.  Follow  established  procedures  necessary  for  translating 
these  objectives  into  performance  terms  and  the  continuation  of  the 
course  development  cycle.  (See  chapter  4.) 

f.  Establish,  in  coordination  with  the  academic,  element  con- 
cerned, the  effective  date  for  inclusion  of  the  new  material  in  appro- 
priate POI. 

5.  Quarterly  List.  Chief,  Training  Publications  Division,  Office 
of  Training  Literature  will  publish,  and  distribute  to  all  academic  and 
staff  elements,  a quarterly  list  of  all  material  received. 


c.  REFERENCES 


1.  AR  71-1. 

2.  AR  70  series  relating  to  combat  developments. 

3.  AR  350-5. 

4.  USASA  Reg  No.  70-2 


CHAPTER  3 


1 


SELECTING  TRAINING  OBJECTIVES 


A.  INTRODUCTION 


1.  Purpose.  The  selection  of  objectives  is  a judgmental  proce- 
dure which  involves  close  scrutiny,  by  qualified  personnel,  of  the  full 
range  of  job  duties,  tasks,  and  elements  performed  by  incumbents  of  an 
MOS  and  detailed  in  job  analysis  schedules.  The  purpose  of  this  chap- 
ter is  to  provide  general  principles,  criteria,  and  procedures  which 
will  function  as  guides  for  the  selection  of  appropriate  training  objec- 
tives and  for  the  assignment  of  priorities  to  these  objectives. 

\ 2.  Importance.  Job  analysis  schedules  prepared  by  Command  Job 

Analysis  Teams  detail  the  full  dimensions  of  an  Agency  job  to  include 
all  of  its  variations  caused  by  the  mission  and  the  product,  and  by 
geographical,  procedural,  and  environmental  conditions.  It  would  be 
extravagant,  in  terms  of  time,  personnel,  money,  and  other  resources 
to  provide  the  kind  and  amount  of  training  required  to  equip  each  grad- 
uate of  the  training  system  to  perform  every  job  task  of  a particular 
MOS  in  any  position  in  the  world.  For  the  same  reason,  it  is  often 
impractical  to  initially  train  personnel  to  the  ultimate  level  of  pro- 
ficiency required  at  some  future  station.  Some  training  is  more  real- 
istically and  more  economically  beneficial  when  conducted  on  the  job. 
Consequently,  it  is  essential  to  select  from  the  total  list  of  job  per- 
formances those  which  are  most  appropriate  for  formal  School  training 
and  to  decide  what  standards  or  level  of  proficiency  will  be  required 
for  successful  course  completion. 


B.  OBJECTIVES  OF  THE  SELECTION  PROCESS 

1.  General . The  process  of  selecting  training  objectives  must 
achieve  the  overall  objectives  of  economy  of  resources,  feasibility, 
and  effectiveness  in  meeting  job  requirements. 

2.  Specific  Objectives,  The  selection  process  must  be  designed 
to  accomplish  the  following: 

a.  Identify  Job  elements  which  are  appropriate  and  feasible 
for  School  training. 

b.  Identify  Job  elements  which  are  appropriate  and  feasible 
for  on-the-job  training. 

c.  Identify  Job  elements  which  are  appropriate  and  feasible 
for  follow-on  training;  i.e,,  advanced  training  for  selected  graduates 
at  NSA,  by  industrial  concerns,  or  at  the  USASATC&S. 
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d.  Specify  the  training  priorities  of  specific  Job  duties 
and  tasks. 

C.  CRITERIA  FOR  SELECTING  TRAINING  OBJECTIVES 


The  following  criteria  are  guider  for  the  selection  of  objectives 
appropriate  for  school  training.  It  should  be  noted  that  it  is  not 
essential  that  all  criteria  be  met  as  a prerequisite  for  including  any 
single  Job  task  or  element  in  the  list  of  training  objectives  for  a 
course.  In  many  cases,  meeting  a single  criterion  is  sufficient  justi- 
fication for  including  the  element  in  the  list  of  training  objectives. 

1.  Universality.  This  criterion  directs  that  emphasis  should  be 
placed  on  the  development  of  job  skills  and  their  associated  knowledge 
supports  and  emotionalized  controls  (ideals,  attitudes,  interests,  and 
appreciations)  which  are  used  by  personnel  in  the  MOS  regardless  of 
where  they  are  assigned.  That  is,  the  job  element  is  required  for 
acceptable  job  performance  at  all  units.  In  essence  then,  the  criterion 
of  universality  asks  the  questions: 

a.  Where  is  this  skill  or  knowledge  used?  In  which  positions? 

b.  Does  it  have  wide  application?  (If  it  occurs  only  in  a 
few  locations,  it  may  be  an  appropriate  objective  for  follow-on  training 
of  some  type.) 

c.  Is  it  so  unique  that  it  was  infrequently  found  in  the  job 
analysis  schedules?  (If  it  is  truly  unique,  the  likelihood  is  that  it 
should  be  taught  on  the  job.) 

2.  Difficulty.  The  criterion  of  difficulty  specifies  that  empha- 
sis in  a training  program  should  be  placed  on  content  or  skills  which 
are  so  difficult  to  learn  that  it  is  highly  unlikely  that  Job  incumbents 
can  acquire  them  on  their  own.  Or,  the  skill  is  so  difficult  to  learn 
that  it  requires  intensive  formal  training,  conducted  by  competent 
instructors,  to  acquire  the  needed  level  of  proficiency.  For  example, 
although  it  is  conceivable  that  an  individual  could  learn  to  read  sche- 
matics on  his  own,  it  would  be  a lengthy  trial-and-error  process.  In 
other  cases,  danger  to  the  man  or  hazard  to  equipment  would  result  from 
the  unguided  efforts  of  a neophyte  to  learn  on  his  own.  Therefore,  the 
criterion  of  difficulty  askB  the  following  questions: 

a.  Is  the  skill  or  concept  difficult  to  acquire? 

b.  Are  personnel  likely  to  learn  this  skill  on  their  own  with 
minimum  danger  to  themselves,  equipment,  or  materials? 

3.  Crucialltv.  This  criterion  points  to  the  need  for  selecting 
skills  and  knowledge  supports  which  are  critically  essential  to  accept- 
able Job  performance  when  needed,  even  though  the  tasks  may  not  be  per- 
formed frequently.  For  example,  consider  the  case  of  the  electronics 
equipment  operator.  More  and  more  equipment  is  being  transistorised  and 
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ia  therefore  leas  aubject  to  malfunction.  This  fact  should  reduce  the 
amount  of  maintenance  training  that  an  operator  requirea.  However, 
there  may  be  a number  of  malfunction  which,  although  occurring  very 
infrequently,  would  be  extremely  critical  if  they  happened,  and  immediate 
corrective  action  were  not  taken  by  the  operator.  Severe  damage  to  the 
equipment,  materials,  or  products  might  be  the  result.  Under  such  cir- 
cumstances, the  criticality  of  the  infrequently  used  skill  is  so  great 
that  the  training  must  be  provided.  In  summary,  the  criterion  of  criti- 
cality asks  the  following  questions: 

a.  How  important  is  the  skill  when  it  is  called  for? 

b.  What  is  the  impact  on  the  mission,  the  operation,  the 
product,  the  equipment,  or  the  operator  when  the  required  skill  is  not 
present? 


4.  Frequency . this  criterion  draws  attention  to  the  need  for 
emphasizing  in  training  those  skills  which  are  used  most  often  on  the 
job.  A skill  which  is  used  frequently,  even  though  it  may  be  acquired 
on  the  job,  may  warrant  formal  School  training  under  certain  conditions. 
For  example,  it  is  often  more  economical  in  time  and  materials  to  teach 
a skill  rather  than  to  allow  personnel  to  learn  it. by  trial  and  error. 

It  is  also  true  that  providing  instruction  results  in  more  efficient  and 
standardized  performance,  and  consistently  higher  quality  in  products  or 
services.  The  criterion  of  frequency,  then,  involves  the  following 
questions: 

a.  How  often  must  the  job  incumbent  perform  this  task? 

b.  Is  it  done  often  enough  to  warrant  training? 

c.  Is  there  a known  "best  way"  to  do  it? 

d.  Should  the  method  of  performing  the  skill  be  standardized? 

5.  Practicability.  This  criterion  points  to  the  need  for  deter- 
mining whether  the  time,  effort,  money,  and  other  resources  required  to 
develop  the  skill  are  commensurate  with  the  gains  in  job  proficiency 
attained  by  trainees;  this  is  the  "Is  it  really  worth  it?"  criterion. 
Although  it  is  possible  to  train  personnel  to  perform  any  job  function, 
the  question  often  arises  as  to  whether  the  cost  of  the  training  can  be 
Justified  in  terms  of  improved  performance.  If  the  proficiency  of 
School -trained  men  in  performing  a skill  is  only  slightly  higher  than 
that  of  an  individual  trained  on  the  job  (or  self-taught),  the  practic- 
ability of  providing  formal  training  is  open  to  serious  question. 
Realistically,  training  should  result  in  a significantly  higher  level  of 
performance  or  a measurably  greater  degree  of  skill  than  can  be  attained 
otherwise.  For  example,  training  in  typing  is  usually  accepted  as  a 
suitable  skill  for  formal  instruction.  However,  it  is  undoubtedly  true 
that  there  is  a "break-even"  point  in  typing  training.  This  is  the  point 
at  which  a further  investment  in  training  results  in  proportionately 
less  improvement  in  typing  skill.  Probably  there  ia  a level  of  skill, 
which  might  ba  stated  in  the  number  of  words  per  minute  with  a maximum 
allowable  number  of  errors,  which  could  be  Juatified  in  terms  of  costs. 
But,  to  continve  formal  training  beyond  this  level  would  result  in  invest- 
ing more  than  the  anticipated  gains  are  worth.  The  higher  standard  might 
be  a proper  goal  for  on-the-job  training. 


6.  Achievabilitv.  This  criterion  directs  attention  to  the  need 
for  considering  whether  an  objective  is  attainable  in  terms  of  the  level 
of  skill  required,  the  aptitude  and  intelligence  of  the  student  input  to 
the  training  program,  and  the  resources  available.  Objectives  must  be 
compatible  with  the  abilities  and  aptitudes  of  the  students,  as  well  as 
with  the  requirements  of  the  job.  To  set  standards  of  accomplishment 
which  are  beyond  the  reach  of  any  sizeable  percentage  of  the  student 
group  is  unrealistic  --  and  expensive  in  terms  of  attrition  from  the 
training  program.  For  example,  referring  back  to  the  typing  situation, 
interview  of  supervisory  personnel  may  indicate  production  could  be 
speeded  up  and  efficiency  improved  if  clerk-typists  were  able  to  type 
at  a rate  of  120  words  per  minute.  Yet,  this  level  of  proficiency 
would  be  unrealistic.  Very  few  students  would  be  able  to  attain  the 
standard.  In  summary,  the  criterion  of  achievabiiity  asks  the  following 
questions: 

a.  Can  the  majority  of  enrollfM  meet  the  standard  prescribed 
by  the  objective? 

b.  Do  they  have  the  aptitude,  intelligence,  maturity,  motiva- 
tion, or  the  experience  required  to  attain  the  desired  standard? 

c.  Can  they  achieve  the  standard  in  a reasonable  period  of 

time? 


7.  Quality.  This  criterion  underscores  the  need  for  selecting  for 
instruction  those  skills  which  are  more  useful  to  men  of  "average"  pro- 
ficiency than  to  those  demonstrating  "mediocre"  or  "outstanding"  profi- 
ciency in  the  job.  In  other  words,  the  objectives  selected  should  reflect 
acceptable  skills  and  standards  rather  than  those  which  either  fall  short 
of  acceptability  or  clearly  exceed  job  requirements.  To  train  individ- 
uals at  a level  of  achievement  which  is  less  than  that  required  on  the 
job  is  to  place  an  unnecessary  burden  on  supervisory  personnel  for 
on-the-job  training.  In  such  cases,  the  training  program  is  not  serving 
the  enterprise  as  it  should.  On  the  other  hand,  it  is  wasteful  to  train 
individuals,  or  to  attempt  to  train  them,  in  skills  and  at  levels  of 
achievement  which  are  characteristic  of  only  the  outstanding  performers. 
The  investment  of  training  resources  will  be  heavy,  and  the  number  of 
individuals  who  complete  the  training  successfully  will  be  few.  In  sum- 
mary, the  following  questions  relating  to  the  criterion  of  quality  should 
be  asked: 

a.  Is  this  skill  required? 

b.  Is  this  level  of  proficiency  demonstrated  by  "average- 
satisfactory"  performers? 

8*  Deficiency.  This  criterion  directs  that  training  should  be 
given  in  those  essential  job  skills  in  which  Job  incumbents  frequently 
demonstrate  inadequate  performance.  In  any  job,  there  are  tasks  which 
are  more  difficult  to  accomplish  (or  easier  to  bungle)  than  other 
aspects  of  performance.  By  tabulating  the  Judgments  of  supervisory 
personnel  regarding  the  difficulties  or  weaknesses  of  their  subordinates, 
an  inventory  of  deficiencies  can  be  produced.  These  items,  regardless 
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of  their  criticality,  might  well  appear  as  points  of  emphasis  in  a 
listing  of  objectives.  For  example,  if  equipment -down  time  is  caused 
by  faulty  soldering  by  repairmen,  this  skill  might  well  require  addi- 
tional emphasis  in  a list  of  objectives  for  the  training  of  repairmen. 

In  summary,  this  criterion  poses  the  following  questions: 

a.  What  skills  are  frequently  performed  poorly  (or  not  at  all) 
by  personnel  in  this  job? 

b.  Which  aspects  of  the  job  require  emphasis  due  to  mistakes 
made  by  a sizeable  percentage  of  job  incumbents,  or  their  display  of  an 
unacceptable  proficiency  level? 

9.  Retainabilitv.  This  criterion  directs  attention  to  the  need 
for  considering  the  time  interval  between  completion  of  training  and 
use  of  the  skill  on  the  job.  Here,  the  determining  factor  is  the  pre- 
dicted (or  measured)  amount  of  deterioration  of  the  skill  that  will  take 
place  during  that  time  Interval.  The  degree  to  which  a skill  degenerates 
through  disuse,  and  the  time  over  which  the  deterioration  takes  place, 
should  play  a large  part  in  determining  the  level  of  performance  required 
for  successful  course  completion.  In  turn,  the  desired  level  of  attain- 
ment will  determine  the  amount  of  time  and  emphasis  given  to  the  develop- 
ment of  the  skill.  Some  skills  degenerate  rapidly;  others  deteriorate 
slowly  or  not  at  all.  Of  course,  this  criterion  is  closely  related  to  a 
few  others,  notably  "frequency"  and  "criticality."  Judgment  must  be 
exercised  in  arriving  at  a determination  as  to  whether  the  skill  should 
be  taught  until  its  use  is  imminent.  If  a decision  is  made  to  teach  the 
skill,  then  the  amount  of  emphasis,  practice,  and  maintenance  training 
required  for  retention  of  the  skill  at  the  .required  level  must  be  deter- 
mined beforehand.  For  example,  the  ability  to  send  and  receive  Morse 
code  are  relatively  difficult  skills  to  acquire.  If  the  skills  are  not 
used,  a certain  amount  of  deterioration  is  certain  to  occur.  If  the 
skills  are  only  rarely  needed  by  personnel,  it  may  be  wise  to  train  only 
a few  communicators.  However,  if  a decision  is  mada  to  train  all  per- 
sonnel as  communicators,  higher  levels  of  initial  proficiency  in  Morse 
code  sending  and  receiving  will  be  required  to  absorb  the  deterioration 
of  the  skills  which  is  certain  to  occur  in  that  all  trainees  will  not 
use  this  knowledge  immediately  in  the  field.  By  increasing  the  standards 
for  School  training,  an  acceptable  level  of  proficiency,  even  following 
disuse,  can  be  assured. 

10.  Follow-on  Training.  This  criterion  points  to  the  need  for  con- 
sidering both  the  kind  and  the  amount  of  training  which  will  be  given  to 
personnel  following  the  completion  of  School  training,  Follow-on  train- 
ing may  take  tha  form  of  advanced  formal  training  or  on-the-job  training. 
A training  program  must  dovatail  with  any  following  training.  Prospec- 
tive graduates  oust  be  brought  to  tha  level  of  proficiency  required  to 
undertake  either  advanced  training  or  on-the-job  training  with  reasonably 
good  chances  for  success  in  the  program,  those  of  us  who  plsn  the  School 
program  must  know  the  entrance  requirements  of  the  follow-on  training; 
and  those  who  plan  the  follow-on  training  must  know  the  miuimum  levels 
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of  proficiency  achieved  by  the  students  in  the  basic  training  program. 

In  short,  initial  training  programs  and  follow-on  training  programs  must 
mesh  to  prevent  unnecessary  costs.  In  sumnary,  the  criterion  of  follow- 
on  training  involves  these  questions: 

a.  What  level  of  proficiency  is  needed  for  a graduate  of  the 
initial  program  to  undertake  either  advanced  or  on-the-job  training 
with- better  than  an  even  chance  of  success? 

b.  What  should  the  planner  of  the  follow-on  training  program 
be  able  to  count  on  in  rerms  of  previous  kinds  and  levels  of  skills 
achieved  by  the  personnel  assigned  to  his  program? 


D.  PROCEDURES 


1.  Preliminary  Review  and  Analysis.  Chief,  Evaluation  Unit  will 
insure  that  evaluators  assigned  the  task  of  selecting  training  objectives 
use  the  following  procedures: 

a.  Review  all  job  analysis  schedules  prepared  for  the  MOS 
under  consideration  and  note  similarities  and  differences. 

b.  Study  the  consolidated  job  analysis  report  for  the  MOS 
and  insure  that  it: 

(1)  Lists  Job  tasks  common  to  all  schedules  prepared  for 
the  MOS.  (The  Job  elements  which  comprise  each  selected  task  are  auto- 
matically included  as  training  objectives.) 

(2)  Omits  all  unique  or  mission-oriented  Job  tasks. 

c.  If  omissions  are  found  in  sections  B and  C of  the  consoli- 
dated Job  analysis  schedule,  prepare  a list  of  the  missing  item*. 

2.  Initial  Selection.  Evaluators  will  perform  initial  selection 
of  objectives  as  follows: 

a.  Using  the  Training  Objectives  Worksheet  (annex  A),  list 
all  of  the  duties  and  tasks  contained  in  section  C of  the  consolidated 
job  analysis  schedule  and  enter  the  additional  items  from  the  separate 
listing  of  omitted  job  tasks. 

b.  Apply  the  criteria  defined  in  section  C of  this  chapter 

to  each  item  in  the  list  of  duties  and  tasks.  Place  a check  mark  in  as 
many  of  the  columns  2 through  11  as  are  applicable. 

c.  Establish  training  priorities  for  each  major  ta*k.  Indi- 
cate the  priority  of  each  task  by  assigning  a priority  number  in  column 

1 4.  • 


1.  Final  Selection.  Final  selection  of  training  objective*  will 
be  accomplished  as  follows: 

a.  Completed  Training  Objectives  Worksheet*  will  be  *ubaitted 
by  evaluators  to  other  Evaluation  Unit  personnel  and  to  qualified 
instructors  in  the  academic  departments  for  review. 


b.  When  all  forma  have  been  reviewed,  Chief,  Evaluation  Unit 
will  call  a meeting  of  all  participants  in  the  selection  process  to 
"iron  out"  differences  regarding  the  selection  of  objectives  and  their 
priorities,  and  to  reach  a consensus  on  the  inclusion  of  specific  duties 
and  tasks  and  their  respective  priorities. 

c.  Following  the  meeting,  Chief,  Evaluation  Unit  will  pre- 
pare a final  list  of  training  requirements,  in  the  order  of  their  pri- 
ority, and  staff  for  coooent/concurrence  to  the  following: 

(1)  Technical  Consultant. 

(2)  Educational  Consultant. 

(3)  Director  of  Instruction. 

(4/  Assistant  Commandant. 

d.  Upon  receipt  of  concurrences  in  the  priority  listing  of 
objectives,  Chief,  Evaluation  Unit  will  draft  performance  objectives 
(See  chapter  4.) 
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Annex  A 

TRAINING  OBJECTIVES  WORKSHEET 


CHAPTER  4 


WRITING  PERFORMANCE  OBJECTIVES 

A.  INTRODUCTION 


1,  Purpose.  Part  of  the  waste  that  occurs  in  training  is 
directly  due  to  the  fact  that  objectives,  eve*"  if  valid,  have  not  been 
stated  in  terms  which  permit  the  development  of  optimally  efficient 
courses  of  instruction.  Too  often,  the  objectives  of  training  programs 
have  been  stated  vaguely.  Typically,  statements  of  objectives  have 
been  worded  "to  provide  the  student  with  a general  knowledge  of...,"  or 
a "working  knowledge  of...,"  or  an  "understanding  of..."  Statements 
such  as  these  are  open  to  any  number  of  different  interpretations; 
therefore,  they  do  not  provide  the  direction  and  guidance  required  to 
develop  instructional  materials  or  to  construct  valid  criterion  meas- 
ures. If  precise  training  is  to  be  provided,  objectives  must  describe 
clearly  what  the  man  must  be  able  to  do.  the  conditions  under  which  he 
must  be  able  to  perform,  and  the  standard  or  criterion  of  acceptable 
performance  at  critical  points  during  the  development  of  job  skills 
and  at  the  end  of  the  training  program.  Hie  basic  purpose  of  this 
chapter,  therefore,  is  to  describe  how  objectives  can  be  set  forth  pre- 
cisely and  unambiguously. 

2.  Essential  Properties  of  Functional  Objectives. 

a.  Minimal  Interpretation.  A useful  objective  pictures 
clearly  and  concisely  the  learner  demonstrating  a specific  desired 
behavior  or  behavior  puttern.  It  must  be  a literal  picture  of  perform- 
ance which  will  be  interpreted  in  the  same  sense  by  all  training  per- 
sonnel in  planning  and  conducting  training  activities, 

b.  Clear  Expression.  As  in  any  coirammication  media,  the 
primary  problem  In  writing  objectives  is  to  provide  a cocroon  base  of 
interpretation  for  ' variety  of  readers.  Vague  or  loaded  words  such 
as  "know"  or  "appreciate"  must  be  consciously  avoided  in  favor  of  more 
explicit  terminology.  Again,  the  intent  is  to  picture  the  student 
behaving  or  performing  specific  actions  within  desired  parameters.  If 
he  must  "know"  something,  what  is  the  demonstrable  behavior  involved? 

In  a more  precise  sense,  is  our  objective  really  to  enable  him  to 
write  something  based  upon  gained  knowledge;  or  perhaps  to  construct . 
or  rearrange . or  compare  certain  variables  utilising  a knowledge  of 
certain  principles?  The  requirement  for  clear  expression  is,  in 
effect,  a demand  f-'t  objective,  action-framed  statements  which  draw 

a picture  of  the  i ldent  behaving  as  e result  of  teaching.  Consider 
the  following  examples  of  vague  terms  in  Group  1 and  the  clearer 
expressions  of  instructional  goals  listed  in  Group  2. 
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Group  1:  Vague  Terms 


Group  2;  Behavioral  Terms 


To  provide  a general  knowledge 
of. . . . 

To  provide  a working  knowledge 
of ... . 

To  qualify. . . . 

To  know  about .... 

To  understand. . . . 

To  develop  an  appreciation 
for. . . . 

To  be  familiar  with.... 

To  orient.... 


To  calculate.... 

To  repair..,. 

To  adjust. . . . 

To  modify. . . . 

To  classify. . . . 

To  install. . . . 

To  construct.... 

To  select. . . . 

To  differentiate. . . . 
To  equate.... 

To  assemble. .. , 

TO  rearrange.... 

To  organize.... 


3.  Characteristics  of  Performance  Objectives.  A performance 
objective  is  a statement  which  clearly  communicates  an  instructional 
intent;  that  is,  it  describes  a proposed  change  in  the  behavior  of  a 
student.  Performance  objectives  have  three  essential  characteristics. 

a*  Hiay  Identify  the  Terminal  Behavior.  The  statement  of  an 
objective  must  identify  exactly  what  the  student  must  be  able  to  do  at 
the  end  of  an  instructional  unit  or  complete  course  of  instruction  to 
demonstrate  that  he  has  achieved  the  required  behavior.  The  learned 
behavior  may  involve  the  application  of  specific  knowledge  or  the 
demonstration  of  a specific  skill  or  constellation  of  skills. 

b.  They  Describe  the  Conditions  of  Performance.  The  state- 
ment of  a performance  objective  must  describe  clearly  and  completely 
the  conditions  under  which  the  student  must  be  able  to  demonstrate  the 
behavior.  That  is,  the  "conditions"  part  of  an  objective  identifies 
what  the  man  will  be  given  to  do  the  job  (tools,  equipment,  job  aids, 
references,  materials),  what  he  will  be  denied  (tools,  equipment,  etc.), 
vhat  assistance  he  will  have  if  any,  what  supervision  will  be  provided, 
and  the  physical  environment  in  which  he  must  perform  (climate,  space, 
light,  etc.). 

c.  They  Set  a Criterion  of  Acceptable  Performance.  The  state- 
ment of  a performance  objective  must  describe  how  well  the  student  must 
be  able  to  perform.  The  criterion  or  standard  establishes  the  minimum 
performance  requirements  for  a Job  duty,  task,  or  element.  To  do  this, 
the  objective  statement  must  prescribe  the  quality  of  the  work  product 
or  service  produced  (accuracy,  completeness,  clarity,  tolerances,  etc.); 
the  quanti ty  of  work  products  produced  (the  number  of  work  units  com- 
pleted); the  time  allowed  to  complete  the  job,  duty,  task,  or  element; 
or  a canbination  of  quality,  quantity,  and  time  standards. 


^Robert  F.  Hager,  Preparing  Objectives  for  Programmed  Instruction. 
Fearon  Publishers,  San  Francisco,  1962,  p.  12. 
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4.  Uses  of  Performance  Objectives,  performance  objectives  pro- 
vide the  basis  for  all  of  the  remaining  steps  in  the  development  of  an 
instructional  system.  They  also  serve  other  administrative  and  train- 
ing purposes.  Some  of  the  more  important  uses  of  performance  objec- 
tives are  as  follows: 

a.  To  Enable  the  Selection  of  Appropriate  Course  Content. 

Well  stated  performance  objectives  provide  a practical  and  objective 
means  of  determining  what  specific  facts,  principles,  and  elements  of 
skill  must  be  included  in  a course  of  instruction.  They  take  much  of 
the  guesswork  out  of  deciding  what  content  is  pertinent  and  what  is 
extraneous . 

b.  To  Permit  the  Selection  of  the  Most  Suitable  Instructional 
Strategy.  Performance  objectives  provide  a clear  description  of  job, 
duty,  task,  and  element  requirements.  Because  they  avoid  equivocation 
and  ambiguity,  the  process  of  selecting  the  optimum  method,  medium,  and 
system  of  organization  is  greatly  simplified. 

c.  To  Establish  Clear-cut  Instructor  and  Student  Goals.  Per- 
formance objectives  permit  both  the  instructor  and  the  student  to  know 
precisely  what  is  required  of  the  student  at  the  end  of  any  instruc- 
tional unit  or  complete  course.  This  knowledge  prevents  gaps  and  unnec- 
essary duplication  in  instruction,  enhances  motivation,  and  makes  learn- 
ing more  effective. 

d.  To  Provide  a Firm  Basis  for  the  Development  of  Criterion 
Measures.  Performance  objectives  are  essential  to  the  construction  of 
valid  and  reliable  criterion  tests.  True  performance  tests  are  diffi- 
cult to  construct  under  any  conditions,  but  without  well-stated  perfor- 
mance objectives  as  a basis,  the  validity  of  criterion  measures  is 
likely  to  be  questionable. 

e . To  Establish  Go/No-Go  Standards  at  Critical  Points  in  a 
Course  of  Instruction.  Performance  objectives  make  it  relatively  easy 
to  determine  at  what  points  in  a course  a student  must  demonstrate  his 
acquired  job  knowledge  and  skills  to  be  able  to  progress  further  in  the 
course.  Such  actions  as  analysis  of  student  difficulties,  provision  of 
remedial  instruction,  recycling,  and  elimination  from  the  course  are 
more  easily  and  more  objectively  accomplished  when  performance  objec- 
tives are  available. 

f . To  Provide  an  Objective  Basis  for  Evaluating  instruction. 
Performance  objectives  provide  the  ingredient  that  has  been  missing  in 
monitoring  programs  — agreement  between  the  evaluator  and  the  one 
evaluated  as  to  what  the  instruction  should  accomplish,  this  fact  per- 
mits objective  evaluation  of  the  instructional  program  in  action. 

g.  To  Provide  a Realistic  Baals  for  the  Evaluation  ef  School 
Graduates  on  the  Job.  It  is  impossible  to  obtain  reliable  judgments  of 
the  effectiveness  of  school -trained  men  in  performing  their  technical 
duties  unless  there  are  firm  and  objective  standards  for  evaluation. 
Performance  objectives  provide  these  standards. 

h.  To  Establish  Requirements  for  On-the-job  Training  programs. 
With  performance  objectives,  field  cossmders  have  a clear  picture  of 
the  knowledge  and  skills  school  graduates  bring  to  the  job.  This  faci- 
litates the  development  of  realistic  on-the-job  training  programs. 
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B.  WRITING  PERFORMANCE  OBJECTIVES 


1.  Steps  in  Writing  Performance  Objectives} 
a . Identify  the  Performance  Requirement . 

(1)  Explanation.  The  essence  of  a performance  objective 
is  found  in  the  description  of  observable,  end-product  behavior.  Al- 
though any  number  of  ingredients  contribute  to  any  observable  behavior, 
i.e.,  knowledges,  skills,  attitudes,  etc.,  it  is  important  that  these 
elements  be  recognized  as  components  of  the  instructional  situation  or 
prerequisites  to  desired  behavior  rather  than  the  goal  behavior  itself. 
Performance  objectives  are,  by  definition,  statements  which  describe 
behavioral  entities  which  are  to  become  established  either  during  or 

at  the  end  of  a sequence  of  instruction  and  can  be  seen  and  measured  as 
such.  Statements  of  desired  behavior  which  meet  this  standard  will  pro- 
vide a firm  foundation  for  planning  instruction  and  ultimately  be  the 
criterion  for  determining  whether  the  instruction  has  been  successful. 

(2)  Examples. 

(a)  "To  develop  an  understanding  of  the  407  Account- 
ing Machine."  This  statement  is  difficult  to  interpret  because  it  does 
not  picture  the  student  displaying  learned  behavior  at  any  point  in  the 
sequence  of  instruction.  Rather  than  outlining  a definitive  picture  of 
a learner  doing  something,  it  sketches  an  abstract  state  of  mind  which 
in  some  way  or  another  relates  to  an  accounting  machine.  Although  many 
desired  behaviors  are  by  nature  abstract,  it  is  also  true  that  these 
behaviors  have  some  outward  manifestation  which  makes  the  cognition,  or 
understanding,  or  appreciation  observable.  If  we  attempt  to  determine 
the  real  behavioral  requirement,  it  might  be  established  that  the 
learner  really  must  be  able  to  "identify'  by  name  each  of  the  controls 
located  on  the  front  panel  of  the  407  Accounting  Machine,"  or  "must  be 
able  to  construct  an  operational  flowchart  of  the  407  Accounting  Machine," 
or  perhaps  the  learner  "must  be  able  to  apply  the  principles  of  logical 
trouble  shooting  to  specified  conditions  of  malfunction  in  the  407 
Accounting  Machine."  Without  emphasizing  the  obvious,  it  is  apparent 
that  the  latter  statements  are  eminently  more  precise  in  coranunlcating 
the  behavior  the  learner  is  really  expected  to  acquire. 

(b)  Another  relatively  common  approach  to  the  state- 
ment of  training  requirements,  particularly  in  the  military,  is  found 
in  the  use  of  such  terms  as  "working  knowledge;"  e.g.,  the  student  must 
have  a working  knowledge  of  the  Radio  Receiver  R390/URR."  Although  the 
phrase  "working  knowledge"  contains  a strong  implication  that  some 
definite  actions  are  to  be  performed  with  the  receiver,  the  statement 
unfortunately  does  not  provide  the  necessary  information  as  to  what 


1 


Ihese  step*  should  be  used  in 


writing  objectives  for  all  lesson  plans. 
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these  actions  are.  Is  the  working  knowledge  equated  to  an  ability  to 
operate  the  receiver,  or  does  it  mean  that  the  student  can  list  the 
operational  characteristics  or  control  parts  or  diagram  signal  flow 
through  the  components?  Whatever  the  case,  the  objective  must  picture 
the  learner  doing  something  with  or  to  the  receiver  as  a result  of 
instruction,  as  opposed  to  leading  him  into  sane  vague  intellectual 
state. 

b.  State  the  Required  Conditions  Accompanying  the  Behavior. 

(1)  Explanation.  Another  ensential  part  of  a complete 
and  explicit  statement  of  required  behavior  is  the  specification  of 
conditions  which  are  ordinarily  present  in  the  behavioral  situation  and 
which  are,  in  fact,  directly  associated  with  the  behavior.  The  condi- 
tions are  environmental  factors  surrounding  the  behavior  or  resources 
the  learner  must  use  in  the  performance.  The  former  encompasses  such 
elements  as  climatic  or  geographic  conditions  such  as  temperature, 
humidity,  light,  location,  terrain,  distances,  etc.  The  latter  in- 
cludes hardware  or  software,  such  as  tools,  references,  guides,  etc., 
and  the  critical  element  of  supervision  or  assistance  received.  Some 
specific  examples  of  conditions  related  to  performance  are; 

"Given  tool  kit  X-3,..." 

"Given  standard  reference  3-65...." 

"Given  an  electronic  scope  and  standard  test  kit...." 

"Given:  Fluctuating  temperature  range  of  60°  to  105°...." 

"Given  the  following:  Altitude  of  2,000  ft,  mean  atmos- 
pheric pressures  of...." 

"With  limited  supervision  (Level  B)...." 

"Under  continuous  supervision  (Level  A)...." 

"Without  supervision  (Level  D)...." 

"Without  the  aid  of  a table  of  cube  roots...." 

(2)  Examples. 

(a)  Example  1.  "The  student  muBt  be  able  to  calcu- 
late resistance,  current  and  voltage  at  selected  points  in  the. . .circuit 
of  a superheterodyne  receiver."  An  examination  of  this  statement  re- 
veals that  the  student  is  pictured  doing  something,  with  particular  end- 
products  desired,  and  in  relation  to  a specific  kind  of  circuit.  How- 
ever, the  statement  still  leaves  unanswered  some  questions  concerning 
the  behavior  to  be  displayed.  Is  the  student  to  perform  these  calcu- 
lations with  or  without  references  containing  formulas  such  as  Ohm's 
law?  Is  Ohm's  law  the  specific  basis  for  the  calculations  or  la  some 
other  calculation  principle  involved?  Will  the  calculations  be  made 
with  test  equipment  on  an  actual  circuit,  or  will  it  merely  be  a paper 
exercise?  If  a circuit  is  involved,  will  the  condition  of  the  circuit 
be  static  or  dynamic?  these  types  of  questions  indicate  that  the 
behavioral  objective  uied  as  an  example  must  be  amplified  to  include 
the  specific  conditions  under  which  the  behavior  is  to  be  displayed. 

The  following  statement  serves  this  purpose  more  effectively.  "Given 
a handout  outlining  Ohm's  law  and  resistor  color  codes;  a voltmeter  and 
aaraeter;  and  10  pre-ad  lusted  receivers  configured  to  represent  variable 
circuit  conditions,  the  student  must  be  able  to  calculate  resistance, 
current,  and  voltage  at  selected  points  in  a superheterodyne  circuit." 
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(b)  Example  2.  "The  student  oust  be  able  to  Hat  in 
writing  the  ten  basic  component  parts  of  the  Radio  Receiver  R-390/URR." 
Must  the  student  provide  this  information  from  memory,  or  will  he  be 
able  to  use  notes,  a chart,  or  a technical  bulletin?  The  statement  is 
not  clear  because  the  conditions  have  not  been  specified.  Consider 
these  improved  statements:  "From  memory,  the  student  must  be  able  to 
list  in  writing  the  five  technical  characteristics  of  the  Radio  Receiver 
R-390/URR,"  Or,  "When  shown  a Radio  Receiver  R-390/URR.  the  student  will 
be  able  to  Identify  orally  by  name  each  of  itB  26  operational  controls 
without  the  aid  of  notes  or  references."  Or,  "Given  a properly  function- 
ing Radio  Receiver  R-390/URR,  and  a set  of  operating  instructions,  the 
student  must  be  able  to  tune  to  any  specified  frequency  within  the 
receiver's  range." 

c.  State  the  Criterion  of  Acceptable  performance. 

(1)  Explanation.  When  the  required  behavior  and  conditions 
of  performance  have  been  described,  the  ability  of  the  objective  to  com- 
municate can  be  increased  by  stating  how  well  the  learner  must  be  able 

to  perform.  This  is  done  by  defining  the  criterion  or  standard  of 
acceptable  performance.  The  criterion  consists  of  words  which  describe 
minimum  acceptable  performance,  set  a time  limit  where  appropriate,  or 
define  quality  and/or  quantity  standards  for  the  work  product  or  service 
produced.  To  insure  that  the  criterion  is  clearly  established,  the 
following  type  of  terminology  is  suggested: 

Within  2 minutes.... 

Without  error.... 

100Z  correct. . . . 

At  least  eight  out  of  ten..,. 

Each  of  the  five  principles.... 

All  of  the  following.... 

To  a tolerance  of,... 

The  exact  techniques  of.... 

Accurate  to  the  nearest  tenth.... 

Within  plus  or  minus  2 degrees.... 

Within  1600  meters. . 

To  conform  to  a template.... 

In  accordance  with  procedures  defined  in.... 

To  the  standards  defined  in,... 

Accurate  to  two  significant  figures..,. 

(2)  Examples.  Study  these  examples  of  objective  statements, 
one  without  a properly  stated  criterion  and  the  other  having  a clear 
standard  of  acceptable  performance. 

(a)  Example  1.  "From  memory,  the  student  must  be 
able  to  list  and  define  in  writing  the  technical  characteristics  of  the 
Radio  Receiver  R"390/URR."  What  is  acceptable  performance  here?  How 
many  technical  characteristics  sre  there?  How  many  oust  the  student 
list  and  define?  How  is  the  adequacy  or  accuracy  of  the  definitions 
checked?  The  objective  does  not  provide  answers  to  those  questions. 
Consider  this  Improved  atataaent.  "From  memory,  the  atudent  must  be 
able  to  list  in  writing  four  of  the  five  technical  characteristics  of 
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the  Radio  Receiver  R-390/URR  and  define  these  characteristics  as  set 
forth  in  pages  5 ard  6 of  TH. ..."  Or,  "When  shown  a Radio  Receiver 
R-390/URR,  fro®  ^mory  the  student  must  be  able  to  identify  orally  by 
name,  each  of  the  26  operational  controls  within  5 minutes  and  with 
complete  accuracy.  Nomenclature  used  must  conform  with  standard  terms 
contained  in  the  operating  manual."  Note  that  the  student  must  be  able 
to  identify  all  26  controls,  within  5 minutes,  and  with  complete  accu- 
racy. There  is  no  Interpretation  needed  to  identify  the  exact  standard 
required. 

(b)  Example  2.  "The  student  must  have  a working 
knowledge  of  resistor  color  coding."  What  must  the  student  "know"  about 
resistor  color  coding?  How  can  acceptable  performance  be  determined? 

This  objective  leaves  many  unanswered  questions.  Consider  this  revised 
statement:  "Given  a schematic  diagram  of  a 5-resistor  series  parallel 
circuit  with  the  values  of  the  resistors  marked,  an  assortment  of  15 
resistors  Including  five  with  values  corresponding  to  those  on  the  dia- 
gram, a circuit  board,  and  wiring,  the  student  must  be  able  to  select 
the  correct  resistors  and  construct  a circuit  electrically  equivalent  to 
the  diagramed  circuit  within  a time  limit  of  10  minutes. " In  this 
example  the  criterion  is  clearly  specified. 

(c)  Example  3.  "The  student  must  be  able  to  use  an 
ammeter  and  voltmeter  to  determine  capacitive  reactance  and  capacitance." 
Here,  the  behavior  is  clear,  but  the  conditions  and  criterion  are  not 
specified.  An  improved  statement  follows.  "Given  a working  two- 
component  series  RC  circuit  connected  to  a variable  frequency  source,  an 
ammeter , a voltmeter,  slide  rule,  pencil,  and  paper,  the  student  must  be 
able  to  determine  the  capacitive  reactance  and  capacitance  to  two  signi- 
ficant figures  and  within  5 percent  of  preestablished  values  within  5 
minutes . The  values  of  the  resistor  and  capacitor  in  the  circuit  will 

be  Illegible,  but  the  settings  of  the  power  source  will  be  visible." 

Note  that  in  this  example  both  a "quality"  ar.d  a "time"  criterion  are 
specified. 


2.  Format.  Although  it  is  possible  to  write  a single  statement 
which  incorporates  the  three  essential  parts  of  a true  performance  objec- 
tive, it  is  far  easier  to  w.'ite  clear  objectives  by  physically  separating 
the  three  parts.  Therefore,  regardless  of  whether  the  performance  objec- 
tive is  written  for  an  MOS,  a duty,  a task,  or  an  element,  a format  sim- 
ilar to  Annex  A should  be  uaed  for  writing  performance  objectives  for 
ell  courses  of  instruction. 

3.  Checking  Performance  Objectives.  Draft  performance  objectives 
oust  be  subjected  to  a final,  rigid  check  prior  to  their  publication  and 
distribution.  The  items  listed  below  are  some  of  the  moat  important 
standards  to  apply  in  checking  the  adequacy  of  performance  objectives. 

a.  General. 

(1)  Are  the  statements  free  from  graamatical,  spelling, 
and  typographical  errors? 

(2)  la  the  sentence  structure  clear,  concise,  simple,  and 
straightforward  ? 
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(3)  I>  tha  uss  of  punctuation,  abbravlatlona,  and  hyphan- 
ation  correct  and  uniform? 

(4)  Do  tha  statamants  avoid  ambiguity? 

(5)  la  extranaoua  or  confualng  Information  excluded? 

b.  Behavior . 

(1)  Doe a tha  8 tat  ament  clearly  and  precisely  describe 
what  die  student  will  be  doing  when  he  demonstrates  what  he  has  learned? 

(2)  Does  the  statement  avoid  the  use  of  "loaded"  words? 

(3)  Does  the  statement  begin  with  a verb? 

(4)  Does  the  statement  describe  a complete  action? 

c.  Conditions. 

(1)  Does  the  statement  clearly  and  completely  describe  the 
conditions  under  which  the  student  must  demonstrate  the  required  behavior? 

(2)  Does  the  statement  begin  with  the  word  "Given"? 

(3)  Does  the  statement  identify  what  the  student  will  be 
given  to  do  the  job  (tools,  equipment,  job  aids,  materials)? 

(4)  Does  the  statement  clearly  identify  the  tools,  equip- 
ment, job  aids,  or  materials  the  student  will  be  denied  (when  this  is 
pertinent)? 

(5)  Does  the  statement  describe  the  physical  environment 
(space,  climatic  condltiona,  lighting  conditions)  in  which  the  job  must 
be  done  (when  these  are  significant)? 

(6)  Does  the  statement  describe  the  assistance  (if  any) 
the  student  will  receive? 

(7)  Does  the  statement  describe  the  amount  and  kind  of 
supervision  (if  any)  the  student  will  receive  during  Job  performance? 

d.  Criterion. 

(1)  Does  the  statement  clearly  describe  how  well  the  stu- 
dent must  perform? 

(2)  Is  the  minimum  level  for  acceptable  performance 
clearly  defined? 

(3)  Is  the  quality  of  the  work  products  or  services 
defined  in  terms  of  standards  of  accuracy,  completeness,  format, 
sequence,  clarity,  neatness,  tolerances,  or  number  of  errors  permitted? 

(4)  Is  the  quantity  of  work  products  or  services  defined 
in  terms  of  the  number  of  units  completed  per  unit  of  time  or  the  total 
number  of  units  required? 

(5)  Ara  time  standards  clearly  defined  in  terma  of  dura- 
tion of  tha  parfomaoce,  speed  of  performence,  or  totel  time  el  lowed 
for  performence. 


C.  PROCEDURES 


1.  Drafting  Performance  Objectives. 

a.  Performance  objectives  will  be  drafted  by  evsluators  on 
IAIEV  Form  1 (sea  Annex  A)  using  as  a basis  tha  final  priority  Hat 
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of  training  requirements. 

(1)  A separate  Performance  Objective  Workcard  will  be  pre- 
pared for  each  job  duty,  task,  and  element. 

(2)  On  each  card,  the  title  of  the  major  duty,  the  title 
of  the  task,  and  the  element  number  (i.e.,  "1  of  3 elements")  will  be 
entered  in  the  spaces  provided. 

(3)  Using  the  steps  defined  in  section  B of  this  chapter, 
separate  entries  will  be  made  to  describe  the  behavior,  conditions  of 
performance,  and  criterion  for  each  job,  duty,  task,  and  element. 

b.  Additional  entries  will  be  made  on  the  card  as  follows: 

(1)  "Major  references"  will  include  the  primary  official 
source  document  relating  to  the  duty,  task,  or  element. 

(2)  "Student  reference"  consists  of  an  entry  of  the  pri- 
mary reference  document  to  be  used  by  the  student. 

2,  Checking  Draft  Performance  Objectives. 

a.  The  drafter  of  a Performance  Objective  Card  will  check 
completed  cards  against  the  list  of  standards  defined  in  paragraph  B3 
above. 

b.  Following  this  check,  the  cards  will  be  submitted  to  two 
other  evaluators  for  review,  again  using  the  standards  defined  in  para- 
graph B3  above. 

3.  Final  Review.  Publication,  and  Distribution. 

a.  A complete  set  of  Performance  Objective  Workcards  will  be 
routed  to  the  Chief,  Evaluation  Unit  for  staffing  and  final  review. 

b.  Following  these  reviews,  Performance  Objective  Workcards 
will  be  prepared  in  final  form  and  reproduced  in  sufficient  copies  to 
meet  requirements. 


D.  REFERENCES 


1.  Mager,  Robert  F. , Preparing  Objectives  for  Programed  instruc- 
tion. San  Francisco,  Fearon  Publishers,  Inc.,  1962. 

2.  Guide  to  the  Preparation  of  Performance  Objectives  (Supplement 
to  USAAVNS  Pamphlet  No.  310-1,  US  Army  Aviation  School,  Fort  Rucker, 
Alabama,  January  1964.) 

3.  Job  Analysis  Schedule,  Form  AGTZ  8,  Office  of  Personnel  Opera- 
tions, Department  of  the  Army,  March  1960. 
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CHAPTER  S 


CONSTRUCTING  CRITERION  MEASURES 

A.  INTRODUCTION 


1,  Definition.  Criterion  measures  are  tests  designed  to  assist 
members  of  the  staff  and  faculty  to  arrive  at  reliable  judgments  con- 
cerning the  adequacy  of  student  performance  on  Job-relevant  behaviors, 
under  either  authentic  or  simulated  conditions,  and  with  predetermined 
"go/no-go"  standards  of  acceptability. 

2.  Sources  of  Criterion  Measures.  At  this  point  a brief  review 
of  the  logic  underlying  the  approach  to  the  improvement  of  training  pro- 
grams may  help  to  set  the  stage  for  the  development  of  criterion  meas- 
ures. Using  classical  job  analysis  procedures,  Agency  Jobs,  Including 
their  component  duties,  tasks,  and  elements,  have  been  analyzed.  Train- 
ing objectives  have  been  derived  directly  from  these  job  data  and  stated 
in  terms  of  Job  duties,  tasks,  and  element  performance  objectives. 

These  objectives  define  the  behaviors  which  the  criterion  must  measure, 
specify  the  conditions  of  performance,  and  identify  the  degree  of  pro- 
ficiency which  a School-trained  man  must  demonstrate  for  each  behavior. 
The  criterion  measure  is  derived  directly  from  the  objectives  and  not 
from  lesson  plans  or  other  curriculum  documents 

Standards.  Because  the  training  objectives  are  based  on  a 
detailed  analysis  of  the  job  for  which  the  students  are  being  trained, 
the  "nice-to-know"  has  been  cut  away.  All  objectives,  then,  are  essen- 
tial, and  the  criterion  measure  should  consist  of  a test  which  measures 
thoroughly  each  and  every  objective  within  the  boundaries  and  terms 
stated  in  the  objectives  themselves.  To  show  that  he  has  attained  the 
objectives,  the  student  must  meet  or  exceed  the  level  of  performance 
required  for  each  essential  training  objective.  Becauae  they  are  all 
essential,  unsatisfactory  performance  on  one  part  of  the  test  cannot 
be  compensated  by  superior  performance  on  other  parts.  Under  these  con- 
ditions, relative  grades  or  standings  become  meaningless.  Therefore, 
standards  for  criterion  measures  must  be  set  in  terms  of  absolute  grades, 
scores,  or  levels  of  performance  that  are  acceptable  as  "minimum  passing" 
or  ''minisum  qualifying." 


B.  PURPOSES  OF  CRITERION  MEASURES 


1.  Syatwa  Validation.  There  are  many  uses  to  which  a test  or 
measure  can  be  put.  However,  during  the  period  when  the  training  system 
is  being  validated,  i.e.,  during  the  conduct  of  pilot  courses,  criterion 
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measures  are  used  to  evaluate  the  Instructional  system  that  has  been 
applied.  That  is,  to  conduct  pilot  courses,  appropriate  content  and 
strategies  have  been  selected,  students  have  been  trained  with  the 
instructional  materials,  and  tests  have  been  administered.  The  test 
scores  are  now  examined  to  see  if  the  instructional  program  was  success- 
ful. Ideally,  every  student  who  completes  the  course  of  instruction 
will  achieve  a perfect  test  score  because  the  criterion  measure  includes 
only  those  behaviors  which  have  been  determined  to  be  relevant  to  the 
Job.  Practically,  however,  a class  average  score  of  90  percent,  with  a 
range  from  80  to  100  percent,  might  be  considered  evidence  that  the 
objectives  of  the  instruction  have  been  achieved.  Actually,  if  90  per- 
cent of  the  class  achieve  a score  of  90  percent  or  higher,  the  students 
"learned"  (met  the  criterion)  and  the  instructional  system  is  proved 
to  be  a good  one.  (This  statement  is  true  for  a 90/90  level  of  achieve- 
ment for  several  pilot  classes.)  If  the  students  did  not  "learn"  (fell 
short  of  the  criterion),  the  system  is  a poor  one.  In  sum,  the  phil- 
osophy of  criterion  testing  is  completely  different  from  conventional 
testing.  Although  a criterion  test  or  measure  can  and  does  test  the 
student,  its  primary  purposes  during  the  validation  phase  are  to  teat 
the  adequacy  of  the  instructional  system,  to  identify  weak  elements  and 
their  causes,  and  to  provide  data  upon  which  to  base  modifications  of 
the  system, 

2.  Conventional  Purposes.  Once  an  instructional  system  has  been 
evaluated  and  has  demonstrated  its  teaching  adequacy,  the  criterion  meas- 
ure can  be  used  for  several  other  purposes. 

a.  To  Evaluate.  Graduate,  or  Eliminate.  Necessary  cut-off 
scores,  based  upon  experience  with  relatively  large  numbers  of  trainees, 
are  established  to  evaluate  trainees  and  to  graduate  or  eliminate  them 
from  the  training  program. 

b.  To  Diagnose  Learning  Difficulties.  This  application 
involves  careful  review  of  the  responses  of  individual  students  to  test 
items.  The  goal  of  this  review  is  tu  identify  specific  requirements  for 
remedial  instruction. 

c.  To  Maintain  Quality  Control.  Here  the  objective  is  to 
evaluate  both  the  students  and  the  instructional  program.  By  systemat- 
ically testing  students  who  have  completed  a training  program,  criterion 
test  ecoree  will  quickly  identify  groups  among  which  proficiency  is  low. 
This  circumstance  raises  questions  about  the  aptitudes  and  motivation  of 
that  group.  It  also  makes  the  Instructional  program  suspect.  An  exam- 
ination of  both  student  input  and  the  test  results  is  thus  Indicated  to 
determine  which  part  of  the  program  has  been  ineffective. 

d.  TO  Pretest  a Group  of  Students.  This  ia  accomplished  prior 
to  their  entry  into  a course  of  instruction  where  appropriate.  Preteats 
furnish  information  on  the  repertoires  of  beginning  students  as  compared 
with  students  who  have  completed  instruction.  This  information  can  be 
used : 

(1)  To  provide  curriculum  builders  and  instructor*  with 
an  inventory  of  the  abilities  o£  the  average  entry  student  population. 
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(2)  To  measure  the  degree  of  learning  and  the  amount  of 
behavioral  change  when  preteat  scores  are  compared  with  post-test  or 
criterion  test  scores. 

(3)  As  an  assignment  device,  to  place  students  at  differ- 
ent stages  of  the  instructional  program  (remedial  for  low  scores  and  by- 
pass for  students  possessing  prior  knowledge  and  skills  in  the  areas 
under  consideration). 

(4)  As  a prerequisite  test  for  enrollment  in  an  advanced 
course  of  instruction. 


C,  TYPES  OF  TESTS  AND  THEIR 
ADVANTAGES  AND  limitations 


1.  Paper  and  Pencil  Objective  Tests. 

a.  Description.  These  measures  are  printed  or  duplicated. 

TV. . t.*  a •„.;>>  either  marks  his  answers  on  the  test,  a separate  answer  sheet, 
or  an  IBM  card.  Questions  may  all  be  written,  or  there  may  be  printed 
numbers,  diagrams,  pictures,  or  other  material  to  accompany  test  items. 

b.  Advantages. 

(1)  Scoring  is  objective. 

(2)  Scoring  is  quick  and  easy. 

(3)  The  tests  can  be  administered  to  large  groups  simul- 
taneously. 

(4)  The  tests  can  be  designed  to  be  self-administering. 

c.  Limitations. 

(1)  Paper  and  pencil  teats  cannot  validly  measure  all 
types  of  behavior. 

(2)  They  are  difficult  to  construct. 

2.  Oral  Objective  Tests. 

a.  Description.  These  tests  are  similar  to  written  tests  in 
their  content  and  method  of  administration  except  that  the  examinee  talks 
instead  of  writes. 

b.  Advantage a. 

(1)  They  are  easy  to  prepare. 

(2)  They  are  easy  to  administer. 

c.  Limitations. 

(1)  They  must  be  administered  to  one  trainee  at  a time. 

(2)  They  are  difficult  tc  score  unless  they  are  the  short- 

answer  type, 

3.  Ratings. 

a.  Description.  Ratings  may  be  adjectival  or  numerical, 
based  on  judgments  made  with  or  without  a scale  which  describes  behavior 
at  several  levels. 

b.  Advantages . 

(1)  Ratings  are  easy  to  collect. 
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(2)  they  are  frequently  easier  to  score  than  other  measures. 

(3)  The  average  Is  likely  to  be  reliable  if  five  or  more 
raters  evaluate  the  behavior  and  the  ratings  are  averaged. 

c.  Limitations. 

(1)  Individual  ratings  are  highly  unreliable. 

(2)  Rating  procedures  are  time-consuming  and,  therefore, 

expensive. 

4.  performance  Tests. 

a.  Description.  Performance  tests  require  the  examinee  to  do 
something.  Usually  what  is  required  is  a sample  of  the  work  associated 
with  a particular  duty  or  task.  Scores  may  be  based  on  time  to  complete, 
accuracy  of  the  work  done,  quantity  of  work  done,  or  quality  of  the  work 
product.  Usually,  a performance  test  requires  the  trainee  to  use  tools 
or  equipment  which  he  will  use  on  the  job.  Occasionally,  a performance 
teat  uses  simulated  tools,  equipment,  or  materials.  In  rare  instances 
special  equipment  may  be  prepared  for  performance  tests. 

b.  Advantages ♦ 

(1)  They  have  face  validity;  i.e.,  they  appear  to  "cover 
the  whole  duty  or  task"  and  they  appear  to  measure  perfectly. 

(2)  They  are  job  oriented. 

c.  Limitations. 

(1)  They  usually  cover  only  a part  of  a job. 

(2)  They  require  more  time  to  administer  per  item  than 
other  types  of  teats. 

(3)  They  are  usually  administered  individually. 

(4)  They  often  require  tools,  equipment,  and  materials 
which  add  to  the  problem  and  expense  of  administration. 

(5)  They  are  difficult  to  design. 


D.  TYPES  OF  CRITERION  MEASURES 


1.  MOS  Qualification  Tests.  For  each  NOS-producing  course,  a 
qualification  test  will  be  constructed.  This  test  will  be  administered 
to  students  at  the  completion  of  the  course.  The  test  will  be  a compre- 
hensive measure  of  the  student's  ability  to  perform  the  full  range  of 
Job  duties  ami  tasks  for  which  the  School  has  provided  training.  The 
t«9t  will  replicate,  as  realistically  as  possible,  the  conditions  under 
which  the  student  will  bo  expected  to  perform  bis  duties  when  assigned 
to  ASA  operating  units.  The  standard  of  performance  for  these  duties 
and  tasks  will  be  that  required  for  acceptable  beginning  job  profi- 
ciency. The  source  of  the  Job  data  for  Che  identification  of  job  skills, 
conditions  of  performance,  and  criteria  of  performance  is  the  Job 
Performance  Werkcards  (IATEV  Form  1)  provided  "->y  the  Evaluation  Unit. 
Successful  performance  on  this  test  will  be  required  for  graduation. 
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2.  Internal  Criterion  Teats.  At  carefully  selected  points  during 
the  conduct  of  an  MOS -producing  course  of  instruction,* internal  cri- 
terion tests  will  be  administered.  Usually,  these  tests  will  cower  a 
single  major  task  of  an  MOS;  however,  these  tests  may  also  cover  clus- 
ters of  related  tasks.  Occasionally,  job  elements  may  be  of  sufficient 
importance  and  complexity  to  warrant  the  development  and  administration 
of  separate  tests.  The  primary  source  of  data  for  the  construction  of 
internal  criterion  measures  is  the  Job  Performance  Workcard  (IATEV  Form  1). 
However,  these  materials  may  be  supplemented  by  references  to  course  con- 
tent found  in  content  outlines  or  in  the  POI  when  academic  prerequisites 
are  of  sufficient  importance  to  justify  separate  testing.  Performance 
standards  for  internal  testa  will  be  consistent  with  criteria  specified 
in  the  Performance  Objective  Workcards.  If  an  internal  test  has  been 
constructed  to  measure  job  knowledge,  rather  than  job  akill,  absolute 
standards,  at  or  near  mastery  of  the  material  (e.g.,  90  percent)  will 
be  established.  These  tests  will  be  used  to  establish  readiness  to 
progress  to  the  ne:«t  unit  of  instruction  ai.d  to  identify  academic  defi- 
ciencies for  remedial  instruction,  recycling,  or  elimination  from  the 
training  program. 


E.  DESIGN  OF  CRITERION  MEASURES 


1.  Forms  of  the  Test.  In  designing  a criterion  test  for  a mili- 
tary training  situation,  conditions  actually  found  on  the  job  should  be 
duplicated  or  simulated,  These  measures  ideally  require  performance  of 

a job  or  a portion  of  it.  It  should  be  evident  that  the  performance  test, 
as  described  in  paragraph  C&  above,  is  the  most  desirable  type  of  cri- 
terion measure.  However,  some  criterion  measures  may  take  the  form  of 
written  or  oral  objective  tests  consisting  of  problems  calling  for  the 
application  of  technical  knowledge. 

2.  General  Characteristics.  An  acceptable  criterion  oust  be 
valid,  reliable,  objective,  administrable,  standard,  and  economical. 
Definitions  of  each  of  these  characteristics  follow. 

a.  ¥alid.  A test  is  valid  when  it  tests  what  it  purports  to 
teat  and  not  something  else.  For  example,  if  a test  is  supposed  to  test 
ability  to  tune  a radio  receiver,  but  actually  tests  reading  ability, 

it  ia  invalid.  Validity  has  implications  for  both  the  form  of  the  test 
(oral,  written,  performance)  and  for  its  coverage.  The  form  must  be 
appropriate  to  the  required  performance  and  the  test  items  oust  e^er 
each  individual  objective. 

b.  Reliable.  A test  ie  reliable  when  it  measures  consist- 
ently; that  is,  the  test  is  atable.  For  exacqrle,  if  the  sat®e  test  is 
administered  on  two  occasions  to  the  same  group  of  students,  who  have 
had  no  addition*!  training  on  the  test  subjects,  the  relative  standings 
of  the  group  should  not  change  appreciably.  If  they  do,  the  teat  is 
unreliable.  Administration  procedures,  scoring,  and  length  of  the  test 
are  factors  in  reliability. 
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c.  Objective.  A test  i*  objective  when  the  Judgment  or  bias 
of  the  scorer  is  eliminated  from  the  scoring.  That  is,  if  ten  scorers 
graded  the  same  test  and  they  all  arrived  at  the  same  score,  the  test 
would  be  objective, 

d.  Administrable,  Administrability  is  insured  by  preparing 
written  directions  for  the  administration  of  the  test  and  requiring 
that  either  the  examiner  read  them  verbatim  to  the  trainees  or  the 
testeea  read  them. 

e.  Standard.  A teat  is  standard  when  a Systematic  sample  of 
performance  has  been  obtained  under  prescribed  conditions  and  scored 
according  to  definite  rules.  In  addition,  the  items  of  a standardized 
test  have  been  experimentally  evaluated  and  evidence  of  validity  and 
reliability  has  been  collected. 

f.  Economical . A teat  is  economical  to  use  when  a minimum 
of  time,  equipment,  and  materials  is  required  to  administer  and  score 
it. 


?.  PROCEDURES 


1.  MOS  Qualification  Teats, 
a.  Test  Planning, 

(1)  Upon  receipt  of  a complete  set  of  Performance  Objec- 
tive Workcards  (IATEU  Forui  1)  from  Chief,  Evaluation  Unit,  Chief,  E6*iT 
Division  will  assign  a test  writer  to  develop  a test  plan  in  the  format 
prescribed  at  annex  A.  The  test  plan  will: 

(a)  Define  the  purposes  of  the  test. 

(b)  Identify  the  specific  job  tasks  to  be  evaluated. 
In  making  this  decision,  the  test  writer  will  consider: 

1.  The  importance  of  the  tasks  to  the  total  job. 

2..  Practical  limitations  of  equipment,  space, 

time,  and  personnel. 

(c)  Determine  the  "type"  measure  to  be  used  in  eval- 
uating each  task  performance.  Selection  of  "type"  measures  will  be 
based  on  the  following  considerations: 

The  probable  validity  and  reliability  of 
the  "type"  measures  to  be  applied. 

2.  Practical  limitations  of  equipment,  space, 

time,  and  personnel. 

(d)  Set  the  standard  of  performance  for  each  task. 

1.,  For  paper-and-pencil  or  oral  objective  tests, 
the  criterion  will  be  stated  as  a percentage  of  items  correct;  e.g.,  90 
per  cent. 

2.  For  ratings,  the  criterion  will  be  stated  as 
an  absolute  score,  e.g.,  30  out  of  a possible  32  points. 

3.  For  performance  tests,  the  criterion  will  be 
a restatement  of  the  crit .rlon  entered  on  the  Performance  Objective 
Workcard. 
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(e)  Enter  additional  information  pertaining  to  the 
evaluation  strategy  in  the  "Remarks"  column  of  the  test  plan. 

(2)  Tha  completed  test  plan  will  be  coordinated  by 
Chief,  E&HT  Division  with  the  academic  department  and  the  action  officer, 
Evaluation  Unit. 

b.  Test  Construction. 

(1)  When  the  test  plan  has  been  coordinated  with  responsi- 
ble individuals  as  indicated  in  paragraph  la (2),  test  writers  will  draft 
the  test  items/situations  using  the  following  guides: 

(a)  SeLct  realistic  and  practical  problems.  Test 
items  should  require  demonstration  of  the  knowledge  or  skills  which  are 
to  be  taught  to  the  student,  or  present  a problem  of  the  type  he  will 
have  to  solve  on  the  job. 

(b)  Select  important  aspects  of  the  Job.  Items/ 
situations  selected  for  a criterion  measure  should  not  deal  with  unim- 
portant details  of  a job. 

(c)  Select  items/situations  which  demand  specific 
job  knowledge  or  skills.  Avoid  questions  or  problems  which  can  be  ans- 
wered or  solved  merely  b y intelligent  reasoning  or  the  application  of 
general  knowledge. 

(d)  Use  job  language.  Items/situations  should  be 
phrased  in  the  working  language  of  the  job;  however,  the  use  of  unneces- 
sary technical  terms  should  be  avoided. 

(a)  Hake  each  itam/situation  independent  of  other 
items.  Test  items  or  situations  should  be  selected  so  that  the  solution 
of  one  item  does  not  give  away  the  answer  to  another.  Nor  should  the 
test  be  so  constructed  that  failure  to  solve  an  item  makes  it  impossible 
to  continue  the  test. 

(f)  Fit  the  difficulty  of  the  item/situatlon  to  the 
required  level  of  Job  knowledge  or  performance.  Tlie  purpose  of  the  test 
is  not  to  trick  the  student  or  mislead  him.  Wide  variability  of  scores 
Is  not  desired  in  a criterion  measure. 

(2)  When  a draft  test  has  been  prepared  by  EfiMT  Division, 
it  will  he  carefully  reviewed  to  insure  that: 

(a)  Hie  test  adequately  samples  the  job  knowledge 
and  skills  of  the  MOS. 

(b)  Each  item/situation  matches  the  specifications 

of  the  test. 


(c)  The  items  are  well  constructed. 

(3)  The  E6MT  Division  test  writer  will  then  prepare 
directions  for  test  administration.  All  directions  must  be  specific, 
complete,  concise,  clear,  and  standardized. 

(a)  Directions  to  the  student  will  include  what  he 
is  to  do,  how  he  is  to  go  about  doing  it,  the  conditions  under  which  he 
will  perform,  and  how  he  will  be  graded. 

(b)  Directions  to  the  examiner  will  include  the  con- 
ditions under  which  the  test  is  to  be  administered,  the  exact  procedures 
to  be  used,  a list  of  the  required  equipment  and  materials,  grading  or 
rating  procedures,  and  a schedule  or  system  of  rotation  if  different 
tasks  are  to  be  evaluated  at  two  or  more  work  stations. 


(4)  The  draft  test  and  directions  for  administration  will 
then  be  submitted  to  the  individual  in  the  responsible  academic  depart- 
ment designated  by  the  department  director  to  review  the  test  for  tech- 
nical accuracy. 

(5)  Following  review  and  correction  of  errors,  Chief, 

E6MT  will  assemble  the  complete  MOS  qualification  test  in  final  form 
for  publication  and  forward  the  package  to  Director,  Office  of  Training 
Literature  for  editing. 

(6)  Chief,  E&MT  Division  will  make  necessary  corrections 
and  forward  through  Director,  Office  of  Training  Literature  to  Publica- 
tions Branch  for  printing. 

(7)  Printed  copies  of  tests  will  be  stored  by  Chief, 

E&MT  Division. 

c . Test  Try-out  and  Revision. 

(1)  Chief,  ESMT  Division  will  select  a representative 
class  of  students  and  administer  the  criterion  test  under  controlled 
conditions. 

(2)  Following  scoring  and  statistical  analysis,  the 
results  of  the  trial  test  will  be  forwarded  by  Chief,  E&MT  Division 
to  Chief,  Evaluation  Unit  for  review. 

(3)  The  test  will  be  revised  in  accordance  with  the 
recommendations  of  Chief,  Evaluation  Unit  and  republished  using  the 
procedures  defined  paragraph  b (5 ) through  (7)  above. 

d.  Test  Administration  and  Processing. 

(1)  Chief,  E&MT  Division  will  administer  criterion  tests 
to  each  MOS  class  (pilot  courses  only),  score  the  tests,  and  perform 
statistical  analysis. 

(2)  "Minimum  qualifying"  scores  for  the  test  will  be 
established  by  Director  of  Instruction  on  recommendation  of  Chief,  E&MT 
Division. 

(3)  Chief,  E&MT  Division  will  prepare  class  rosters 
showing  each  student's  score  on  the  test  and  designating  each  student 
as  being  Q (qualified)  or  U (unqualified).  These  rosters  will  be  dis- 
tributed as  follows: 

(a)  Chief,  Academic  Affairs  - original  and  one  copy, 

(b)  Director  of  Instruction  - one  copy. 

(c)  Director,  Academic  Department  concerned  - one 

copy. 

(d)  Chief,  Academic  Division  concerned  - one  copy. 

(e)  Chief,  EfiMT  - one  copy  (for  file). 

2,  Internal  Criterion  Tests. 

a.  ’Past  Planning. 

(1)  Upon  completion  of  the  content  outline  and  the 
sequence  of  job  tasks,  the  Director,  Academic  Department  concerned  will 
forward  a copy  of  the  outline  and  the  sequence  to  Chief,  E6MT  Division 
for  the  development  of  test  plans. 
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(2)  Chief,  E£MT  Division  will  assign  a test  writer  to 
develop  a series  of  test  plans  for  the  course. 

(3)  The  test  writer  will  determine  the  number  of  Internal 
Criterion  Tests  required.  This  decision  will  be  based  on  the  following: 

(a)  Each  internal  test  will  cover  a logical  grouping 
of  Job  tasks  or  elements  as  defined  in  the  Performance  Objective  Work- 
cards  (IABV  Form  1). 

(b)  The  content  outlines  which  support  the  task  level 
Performance  Objective  Workcards  will  be  reviewed  to  Insure  adequate 
sampling  of  job  knowledge  and  skills  taught  in  the  block  of  instruction 
covered  by  the  test. 

(c)  The  sequence  of  tasks  provided  by  the  responsible 
academic  department  will  be  followed  to  determine  appropriate  points 
for  the  administration  of  tests. 

(d)  Tasks  critical  to  the  development  of  acceptable 
job  performance  and  to  further  progress  in  the  course  will  be  selected 
for  testing. 

(4)  A test  plan  for  each  Internal  Criterion  Test  will  be 
prepared  in  the  format  prescribed  in  annex  A using  the  procedures 
defined  in  paragraph  la(l)  of  this  section. 

(5)  The  completed  test  plans  will  be  routed  through 
Chief,  E6MT  Division,  Director  Academic  Department  concerned,  Director 
of  Instruction,  Chief,  Evaluation  Unit,  and  the  Technical  Consultant 
for  review  and  approval. 

b.  Teat  Construction.  When  the  test  plans  have  been 
approved,  E6MT  Division  test  writers  will  construct  draft  tests  using 
the  guides  defined  in  paragraph  lb  of  this  section. 

c.  Test  Try-out  and  Revision.  See  paragraph  lc  of  this 

section. 

d.  Test  Administration  and  Processing. 

(1)  Chief,  E6MT  Division  will  provide  for  the  adminis- 
tering of  criterion  tests  to  each  MOS  class,  the  scoring  of  the  tests, 
and  the  performance  of  statistical  analyses. 

(2)  "Minimum  passing'*  scores  for  each  test  will  be 
established  by  Director  of  Instruction  on  recommendation  of  Chief, 

EMIT  Division. 

(3)  Chief,  E&MT  Division  will  prepare  class  rosters  fol- 
lowing each  test  administration.  These  rosters  will  show  each  stu- 
dent's score  and  the  designation  P (pass)  or  F (fail).  Rosters  will 
be  dietribufced  as  follows: 

(a)  Chief,  Academic  Affairs  - original  and  one  copy, 

(b)  Director  of  Instruction  - one  copy. 

(c)  Director,  Academic  Department  concerned  - one  copy. 

(d)  Chief,  Academic  Division  concerned  - one  copy. 

(e)  Chief,  E&MT  - one  copy  (for  file). 
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CHAPTER  6 


SELECTING  AND  SEQUENCING  COURSE  CONTENT 
A.  INTRODUCTION 


1.  Review  of  Steps.  The  sequence  of  steps  in  the  development  of 
an  Instructional  system  up  to  this  point  provides  the  broad  framework 
for  a course.  In  the  initial  step,  the  total  job  was  analyzed,  with 
all  of  its  variations,  as  it  is  performed  in  the  field.  A decision  was 
made  as  to  exactly  which  duties  and  tasks  should  be  the  objectives  of 
School  training  and  which  requirements  should  be  handled  by  on-the-job 
training.  In  subsequent  steps,  what  the  learner  must  demonstrate  that 
he  is  able  to  do  as  a result  of  training,  the  conditions  under  which  he 
must  be  able  to  perform,  and  the  standard  or  criterion  of  performance 
required  were  defined.  The  emphasis  up  to  this  point  has  been  on  how 
the  learner  will  perform  following  specific  learning  activities.  Any 
reference  to  content  or  learning  activities  has  been  deliberately 
avoided  and  the  focus  has  been  kept  on  the  required  performance. 

2.  The  Relationship  Between  Content  Selecting  and  Sequencing. 

Now  that  the  required  performances  have  been  clearly  defined,  the  know- 
ledges, skills,  and  values  which  support  each  performance  objective  and 
the  sequence  of  their  development  can  be  identified.  Essentially,  the 
job  is  twofold:  first  to  examine  each  performance  objective  and  iden- 
tify the  specific  concepts,  principles,  facts,  and  operations  involved 
in  each  task;  and  second,  to  arrange  these  teaching  points  in  the  best 
order  for  learning.  Although  the  processes  of  selecting  and  sequencing 
content  are  closely  related  and  interwoven,  for  purposes  of  clarity 
each  process  will  be  discussed  separately. 


B.  CONTENT  SELECTION 


1.  Sources  of  Content.  Official  publications  of  Department  of 
Defense,  Department  of  the  Army,  NSA,  and  HQ  USASA  are  the  primary 
sources  of  the  concepts,  principles,  facts,  skills,  and  values  which 
make  up  the  course  content.  Such  documents  as  TW's,  FM’s,  NSA  and  ASA 
ma. mals,  directives,  and  instructions  are  included  in  this  category. 
Secondary  sources  of  course  content  include  locally  developed  documents, 
such  as  school  position  papers  and  lesson  plans.  Secondary  references 
may  be  used  as  sources  only  in  the  absence  of  official  publications 
dealing  with  the  consent  required  to  support  a performance  objective. 


2.  Criteria  for  Content  Selection.  There  are  two  categories  of 
criteria  which  oust  be  applied  In  selecting  course  content.  The  first 
category  relates  to  the  source  documents  used  as  a basis  for  content 
selection.  The  second  deals  with  the  relationship  of  content  to  the 
achievement  of  the  required  standard  of  performance. 

a.  Documentary  Criteria.  The  following  items  are  important 
from  the  standpoint  of  selection  of  source  documents: 

(1)  If  official,  the  document  roust  be  the  most  recent 

edition. 

(2)  If  locally  produced,  the  document  must  represent  an 
approved  "school  position." 

b.  Job  Criteria.  The  following  items  are  critical  during 
the  selection  of  specific  course  content: 

(1)  The  content  is  directly  related  to  an  element  of  job 
performance  as  proven  by  job  analysis  and  defined  on  performance  Objec- 
tive tforkcards  (IATEV  Form  1). 

(2)  The  content  is  critical  to  the  development  of  the 
required  job  performance.  That  is,  the  man  could  not  perform  the  Job 
satisfactorily  without  the  knowledge  or  skill. 

3.  The  Process  of  Content  Selection.  The  act  of  "breaking  out" 
the  concepts,  principles,  facts,  and  skills  which  support  a performance 
objective  is  comparable  to  the  process  of  outlining  the  "points-to-be- 
taught"  in  a conventional  lesson  plan.  The  essential  difference  is  that 
the  content  selector  has  a list  of  specific  statements  of  required  per- 
formance rather  than  vague  guides  such  as  to  provide  a "working  knowledge" 
of  some  subject.  The  fact  that  he  has  a set  of  performance  objectives 
permits  the  content  selector  to  focus  on  learning  outcomes  and  identify 
the  "meat"  of  the  lesson  more  precisely.  This  does  not  mean  that  the 
presence  of  performance  objectives  makes  content  selection  a mechanical 
process,  but  it  does  simplify  the  Job  and  removes  most  of  the  guesswork. 


C.  COURSE  SEQUENCING 


I.  Definition.  Learning  is  a "building  block"  process  which 
results  in  a change  of  behavior.  Changes  in  what  a person  is  able  to 
do  are  developed  gradually  and  in  stages.  Sequencing  is  the  process 
by  which  learning  experiences  are  placed  in  the  configuration  which 
will  produce  the  most  learning  in  the  shortest  period  of  time.  It 
avoids  both  unnecessary  duplication  and  gaps  in  content.  Adequate 
sequencing  insures  that  component  knowledges  and  skills  have  been 
developed  before  the  complete  behavior  is  to  be  demonstrated.  Proper 
sequencing  guarantees  that  the  development  of  a skill  is  orderly,  and 
that  prerequisite  learnings  have  been  acquired  prior  to  the  introduction 
of  advanced  content  or  skills. 


2.  Types  of  Sequencing.  The  sequence  of  lessons 'in  a course  of 
Instruction  can  be  baaed  on  one  or  more  of  the  following  conditions: 

a.  Job  Performance  Order.  This  is  a sequence  based  on  the 
order  In  which  a job,  duty,  task,  or  element  is  actually  performed. 

b.  Logical  Order.  This  is  a sequence  dictated  by  the  inher- 
ent logic  of  the  subject-matter;  e.g.,  mathematics. 

c.  Psychological  Order.  This  is  an  ordering  of  content  based 
on  ease  of  learning.  In  general,  it  meaus  that  older  learnings  serve  as 
the  basis  for  new  learnings,  that  when  possible,  the  learner  moves  from 
th«  simple  to  the  complex,  from  the  familiar  to  the  unknown,  from  the 
concrete  to  the  abstract.  In  actual  practice,  all  types  of  sequencing 
have  their  place  in  course  development.  All  types  will  be  used.  How- 
ever, sequencing  decisions  must  be  based  on  the  actual  content.  Involved 
in  the  development  of  specific  job  cask  or  element  performances.  Both 
content  selection  and  sequencing  must  be  completed  before  lesson  plans 
and  teaching  aids  are  developed. 

3.  Sequencing  Guides.  The  following  guides  should  be  used  in 
determining  the  sequence  of  tasks  and  the  sequencing  of  elements  within 
a task. 

a.  Place  easily  learned  tasks  early  in  the  course. 

b.  Introduce  early  in  the  sequence  broad  concepts  and  techni- 
cal terms  which  have  application  throughout  the  course. 

c.  Place  application  of  concepts  close  to  the  point  of  ini- 
tial development. 

d.  Place  requisite  skills  and  knowledges  in  the  sequence 
prior  to  the  points  where  they  must  be  combined  with  subsequent  ones  and 
applied. 

e.  Provide  for  maintenance  and  review  of  skills  and  knowledges 
which  are  essential  parts  of  later  tasks  and  duties. 

f.  Introduce  a concept  or  skill  in  the  task  in  which  it  is 
most  likely  or  most  frequently  to  be  used. 

g.  Don't  "overload"  any  task  with  difficult-to-learn  elements. 

h.  Provide  for  redevelopment  and  practice  of  required  skills 
and  concepts  in  areas  where  transfer  of  identical  or  related  skills  is 
not  likely  to  occur. 

i.  Place  complex  or  cumulative  skills  late  in  the  course 

sequence. 


D.  PROCEDURES 


1.  Preliminary  Steps. 

a.  When  performance  objectives  have  been  developed  for  a 
course  of  instruction,  Chief,  Evaluation  Unit  will  forward  the  Perform- 
ance Objective  Workcards  (IATEV  Form  l)  through  the  Director  of  Instruc- 
tion to  the  academic  department  responsible  for  selection  of  course  con- 
tent and  sequencing.  (See  annex  A.) 


b.  The  Director  of  the  responsible  department  will  designate 
a project  officer  for  course  development  and  provide  MOS-quallfied  per- 
sonnel as  assistants. 

c.  A representative  of  the  Evaluation  Unit  will  brief  the 
project  officer  and  his  assistants  on  requirements  and  procedures. 

2.  Initial  Content  Selection. 

a.  Vie  project  officer  and  his  assistants  will  examine  each 
performance  objective,  end  develop  separate  topical  outlines  for  each 
Job  Element  Objective  Card.  (See  annex  B.)  These  outlines  must  include 
all  of  the  major  knowledges  and  skills  required  to  achieve  the  perform- 
ance specified.  The  product  of  this  step  is  a complete  outline  of  all 
required  learnings  for  each  job  element.  Ihat  is,  every  specific  con- 
cept, principle,  skill,  or  value  required  for  demonstration  of  each 
objective  is  listed  regardless  of  the  fact  that  duplicate  items  may 
appear  under  two  or  more  objectives. 

b.  Objectives  and  content  outlines  are  then  submitted  to  the 
Department  Director  for  a check  of  completeness  and  accuracy.  The  pur- 
pose of  this  step  is  not  to  review  for  detail,  but  rather  to  insure  that 
major  items  of  content  required  for  performance  have  been  included  and 
that  nonessential  content  has  been  omitted. 

3.  Initial  Sequencing. 

a.  Upon  approval  of  the  content  outlines,  the  project  officer 
and  his  assistants  will  arrange  the  objectives  and  content  outlines  in 
developmental  learning  order.  This  task  will  be  accomplished  as  follows: 

(1)  Using  the  general  guides  described  in  section  C3,  lay 
out  the  Job  task  cards  with  their  supporting  element  cards  and  content 
outlines. 

(2)  Code  each  item  in  the  content  outline  to  the  appro- 
priate performance  objective  element  card.  (See  annex  C.) 

(3)  Determine  whether  each  item  of  content  should  be  ini- 
tially developed  within  the  task  where  it  first  appears  in  the  sequence 
of  tasks.  If  so,  annotate  the  outline  and  the  element  card  "ID" 

(Initial  Development),  If  it  should  be  initially  developed  in  another 
task,  annotate  both  the  eard  and  outline  under  the  proper  task.  Anno- 
tate all  duplicate  element  cards  and  supporting  outlines  with  the 
inscription  "PR"  (Prerequisite).  These  are  job  elements  which  are 
required  for  performance  of  tue  cask  but  which  must  be  developed  earlier 
in  the  sequence. 

(4)  When  specific  elements  and  their  supporting  content 
are  obviously  interdependent,  a compromise  must  be  made.  Hake  the  deci- 
sion as  to  where  in  the  sequence  the  element  should  be  placed  on  the 
basis  of  secondary  guides  such  as  difficulty  of  acquiring  the  akill  or 
knowledge,  or  on  the  basis  of  an  equitable  distribution  of  difficult 
learnings  among  the  several  tasks,  (See  annex  D.) 

(5)  The  tasks  are  now  resequenced  according  to  the  order 
imposed  by  the  coding  of  "prerequisite"  and  "initial  development"  ele- 
ments. (See  annex  E.) 
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(5)  Elements  within  each  task  are  resequenced  in  the  same 

way. 

4.  Refined  Content  Outlines. 

a.  Now  that  a tentative  sequence  of  job  elements  has  been 
established,  the  content  selector  starts  with  the  first  performance 
objective  and  proceeds  to  develop  s detailed  content  outline.  Each  Item 
In  the  preliminary  outline  Is  analyzed  and,  using  appropriate  references, 
the  teaching  points  are  developed  in  the  form  of  declarative  statements. 

b.  Hie  final  step  is  to  examine  all  of  the  detailed  content 
outlines  and  eliminate  any  unnecessary  duplication  which  may  have 
occurred  within  the  detailed  points-to-be-taught. 

c.  When  a teaching  point  essential  to  the  development  of  a 
concept  or  skill  late  in  the  course  sequence  duplicates  a teaching 
point  developed  earlier,  it  should  be  clearly  identified  as  a review 
item  of  content. 

5.  Final  Sequencing. 

a.  Hie  refined  content  outlines  are  now  compared  with  each  set 
of  task  element  cards. 

b.  Final  adjustments  forced  by  the  detailed  content  outlines 
are  made.  (See  annex  S.) 
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this  deck  of  cards  consists  of  Performance  Objectives  for  the  Duties, 
Tasks,  and  Elements  of  the  job.  Pictured  above  is  a basic  sat  of  three 
tasks  vith  their  accompanying  elements.  We  shall  follow  these  cards  through 
the  etaps  of  content  selection  and  sequencing. 


Annex  B 


TASK  A 


TASK  B 


TASK  C 


ELEMENT  A1 


ELEMENT  Bl 


ELEMENT  A2 

ELEMENT  B2 

ELEMENT  Cl 


ELEMENT  C2 


ELEMENT  A3 


ELEMENT  B3 


ELEMENT  C3 


ELEMENT  AA 


CONTENT 

OUTLINE 

Skill  1 
Skill  2 
Skill  3 


CONTENT 

OUTLINE 

Skill  1 
Skill  2 
Skill  3 
Skill  4 


CONTENT 

OUTLINE 

Skill  1 
Skill  3 
Skill  4 


PREPARATION  OP  CONTENT  OUTLINES 

The  project  officer  end  his  teae  will  prepare  a content  outline  for 
each  task.  This  outline  will  list  all  of  the  skills  and  knowledges  which 
are  actually  required  to  persona  the  elements  of  each  task  and,  collectively, 
to  perform  the  taak.  In  the  illustration  above,  there  are  duplicate  nuabera 
representing  these  required  skills.  This  is  due  to  the  fact  that  a basic 
set  of  required  skills  will  often  appear  under  two  or  more  tasks.  Identify- 
ing these  duplications  will  permit  optimum  sequencing. 
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Annex  C 


TASK  A 

TASK  B 

TASK  C 

CONTENT 

CONTENT 

CONTENT 

OUTLINE 

OUTLINE 

OUTLINE 

Skill  1 ID 

Skill  1 

Skill  1 

Skill  2 

Skill  3 

Skill  3 ID 

Skill  3 

Skill  5 ID 

Skill  4 ID 

Skill  4 

' — 4 

CONTENT  CODING 

Each  required  skill  and  knowledge  oust  be  cx&rained  to  determine 
where  they  will  be  initially  developed  (ID).  Using  the  sequencing  guides 
defined  in  paragraph  C3  of  this  chapter,  cede  those  i tens  ir.  the  content 
outline  which  oust  be  initially  developed  within  a task  as  IR,  At  this 
point,  unr.oded  it  etas  are  those  skills  or  knowledges  .hich  oust  be  developed 
before  the  task  is  taught. 


TASK  C 


TASK  B 


ELEMENT  A1 


ELEMENT  A2 


E1EMENT  A/< 


CONTENT 

OUTLINE 

Skill  1 ID 
Skill  2 
Skill  3 


ELEMENT  C2 


n 


CONTENT 

OUTLINE 

Skill  1 
Skill  3 ID 
Skill  4 ID 


ELEMENT  Bl 


ELEMENT  B2 


ELEMENT  A3 

- 

ELEMENT  C3 

ELEMENT  B3 


ELEMENT  B4 


CONTENT 

OUTLINE 

Skill  1 
Skill  3 
Skill  5 ID 
Skill  4 


j 

** 

J 


INITIAL  SEQUENCING 

The  tasks  are  sequenced  according  to  the  specifications  "forced" 
by  the  initial  development  coding.  Note  the  problem*  caused  by  the 
two  required  ekille  in  the  content  outline  of  T*ak  A.  Theee  ekille 
have  not  been  developed  as  yet  and  are  prerequieites.  Adjuatmnta  or 
compromises  oust  be  made  to  correct  thia  situation. 


The  last  step  is  to  make  adjustments  required  by  the  selection  of 
points  fur  the  initial  development  of  a skill.  Here  we  have  made  the 
necessary  adjustments; 

Task  A There  Is  nothing  before  this  task  so  all  skills  must  be 
developed  initially. 

Task  C Required  skill  1 is  developed  in  Task  A. 

Required  skill  3 is  developed  in  Task  A. 

Required  skill  4 is  initially  developed. 

Task  B Required  skill  ! is  developed  in  Task  A. 

Required  skill  3 is  developed  in  Task  A. 

Required  skill  5 is  initially  developed. 

Required  aklll  4 is  developed  in  Task  C. 

The  identical  procedure  can  be  used  to  sequence  the  element*)  within 
a task. 


—"sa 
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CHAPTER  7 


SELECTING  INSTRUCTIONAL  STRATEGIES 

A,  INTRODUCTION 


1.  Purpose  of  the  Chapter.  Better  understanding  of  how  people 
laarn  and  'he  evolution  of  modern  aids  to  teaching  and  learning  have 
resulted  in  the  development  of  a great  variety  of  Instructional  strate- 
gies, methods,  systems  of  organization,  and  mediating  devices.  This 
chanter  identifies  the  more  important  strategies,  Indicates  the  situ- 
ations in  whicn  they  should  be  used,  notes  their  advantages  and  limita- 
tions, and  describes  procedures  to  be  followed  in  arriving  at  strategy 
decision.*. 

2.  Importance  of  Strategies. 

a.  Proper  Selection.  Except  for  the  selection  of  training 
objectives,  proper  selection  of  strategy  will  do  mOre  to  promote  effi- 
ciency and  effectiveness  of  instruction  than  any  other  measure.  This 
fact  has  largely  been  overlooked  in  training  and  education.  All  too 
often  the  selection  of  strategy  has  been  dictated  by  expediency  rather 
than  choice.  Strategy  must  be  selected  through  systematic,  objective 
means  if  Inefficiency  in  attaining  objectives,  or  worse,  failure  to 
achieve  objectives,  is  to  be  avoided. 

b.  Compatibility.  There  is  no  single  best  method  of  teaching 
which  applies  to  all  learning  situations  or  instructional  objectives. 

The  instructor  must  choose  the  strategy  which  is  most  compatible  with 
the  objectives  of  the  Instruction,  the  nature  of  the  School  organization, 
the  facilities  and  equipment  available,  the  background  and  level  of  the 
atudenta,  and  his  own  abilities. 

c.  Variation  of  Methods.  The  accomplished  instructor  is  one 

who  has  developad  skill  in  using  a great  variety  of  mathoda  and  techniquaa. 
For  each  objective  to  be  reached,  the  instructor  can  select  from  among 
various  methods,  the  specific  methods  which  will  best  carry  his  students 
to  the  goal.  The  instructor  who  is  limited  in  methods  often  tries  to 
reach  an  objective  by  using  Inappropriate  technique*.  The  result  is 
lack  of  student  interest  and  attention,  inefficient  learning,  or  failure 
to  achlsve  the  instructional  goals. 

d.  Repertoire  Requirement.  Too  many  instructors  use  only  one 
or  two  mathode.  Many  Instructors  lecture  moat  of  the  time.  Today,  with 
the  great  variety  of  interesting  and  effective  ways  of  helping  etudentf 
learn,  the  military  Instructor  should  develop  a repertoire  of  approechee. 
Then,  rather  than  use  the  same  methods  for  all  lessons,  he  can  draw  frco 
his  repartolre  the  ones  which  are  moat  appropriate  for  a particular  ait- 
uation. 


3.  Definitions.  Although  the  terms  method,  technique,  approach, 
and  strategy  have  often  been  used  interchangeably,  there  are  important 
differences  among  them.  To  clarify  theee  terms  and  to  distinguish 
among  them,  the  following  definitions  are  offered: 

a.  Instructional  Strategy.  An  instructional  strategy  is  a 
combination  of  teaching  methods  and  techniques  designed  to  accomplish  an 
instructional  Job.  It  includes  mediating  devices  when  used,  and  a sys- 
tem for  organizing  instructors  and  students. 

b.  Instructional  Method.  An  instructional  method  is  the  basic 
approach  to  instruction.  It  may  be  a lecture,  demonstration,  conference, 
performance,  programed  instruction,  study  assignment,  tutoring,  or  a 
combination  of  two  or  more  of  these  basic  approaches.  Methods  may  be 
cataloged  under  three  headings: 

(1)  Primary.  A primary  method  is  an  approach  which  is 
objectively  Judged  to  be  the  most  effective  and  efficient  means  of 
attaining  an  instructional  objective. 

(2)  Supporting.  A supporting  method  is  an  approach  which 
is  objectively  Judged  to  be  an  essential  complement  to  a primary  method; 
that  is,  it  must  be  used  in  conjunction  with  the  primary  method  to 
Insure  the  attainment  of  the  instructional  goal. 

(3)  Alternative . An  alternative  method  is  an  approach 
which  may  be  used  as  a substitute  for  the  primary  or  supporting  method 
when  circumstances  do  not  permit  the  use  of  the  optimum  method. 

c.  Instructional  Technique.  A technique  of  instruction  is  a 
means  of  instruction  which  complements  a method;  e.g.,  questioning, 
handling  student  responses,  and  using  visual  and  auditory  aids. 

d.  Systems  of  Organization.  A system  of  organization  is  a 
means  of  grouping  instructors  and/or  students  for  instruction;  e.g., 
random  grouping,  team  teaching,  and  team  learning. 

e.  Mediating  Device.  A mediating  device  is  a specialized 
piece  of  equipment,  or  system,  specifically  designed  to  assist  in  the 
presentation  of  instruction;  e.g.,  teaching  machines,  classroom  student 
response  systems,  computer-based  instructional  systems,  and  closed- 
circuit  television  systems  (to  include  video-tape  and  kinescope  record- 
ing and  playback  facilities), 

A.  Basic  Factors  to  Consider.  Every  instructional  strategy  has 
certain  advantages  and  limitations.  It  ie  essential  that  careful  con- 
sideration be  given  to  these  advantages  and  limitations  to  Insure  that 
the  strategy  selected  for  a specific  Instructional  Job  is  the  one  which 
will  be  most  effective  and  efficient.  Strategy  decisions  must  be  based 
on  careful  analysis  of  the  training  situation  from  several  standpoints: 
instructional  objectives,  subject-matter,  student  population,  and  instruc- 
tor, instructional  facilities,  equipment  and  materials,  time,  and  costa. 

In  the  following  paragraphs,  each  of  these  factors  is  discussed. 

a.  Instructional  Objectives.  The  overriding  consideration  in 
tha  selection  of  a strategy  is  the  objective  of  instruction,  that  is, 

'dia t the  student  will  ho  required  to  do  either  during  a later  stage  of 
his  training  or  on  the  Job  in  cho  field.  If  the  objectives  of  a speci- 
fic block  of  instruction  deal  with  Job  knowledges  as  supporting  elements 


for  the  developoent  of  terminal  behaviors,  the  strategy  selected  may  be 
different  from  the  method  chosen  to  develop  job  performance  skills. 
Objectives  oust  also  be  examined  to  determine  whether  the  instructional 
job  is  to: 

(1)  Introduce  a subject. 

(2)  Provide  remedial  assistance. 

(3)  Accelerate,  enrich,  or  build  academic  skills. 

(4)  Teach  manual  or  manipulative  skills. 

(5)  Build  concepts. 

(6)  Teach  operation  and  functioning  of  equipment. 

(7)  Develop  teamwork. 

(8)  Stimulate  interest. 

(9)  Improve  reasoning  and  problem-solving  ability. 

(10)  Accomplish  any  one  of  a host  of  other  objectives  which 
are  appropriate  for  school  training. 

b.  Course  Content.  The  nature  of  the  content  itself  must  be 
considered  in  selecting  an  instructional  strategy.  The  stability  of  the 
content,  whether  verbal  or  manipulative,  and  its  difficulty  determine  to 
a great  extent  the  strategy  which  is  most  appropriate. 

c.  The  Student  Population.  The  size  of  the  student  group,  the 
educational  level,  prior  training,  aptitudes,  maturity,  reading  and  speak- 
ing ability,  and  the  teaching  location  must  be  considered  in  selecting  a 
strategy.  For  example,  optimum  conditions  for  the  application  of  speci- 
fic methods  demand  establishment  of  maximum  and  minimum  class  sizes. 

Where  class  size  exceeds  or  falls  short  of  the  established  figure,  an 
alternative  method  may  be  necessary. 

d.  Instructors.  The  number,  quality,  and  competencies  of 
available  instructors  is  an  important  factor  to  consider  in  selecting  a 
strategy.  For  example,  in  a given  situation,  if  technically  qualified 
instructors  are  not  available  in  sufficient  numbers  to  handle  the  student 
input,  the  use  of  programmed  materials  may  be  dictated  rather  than  a more 
appropriate  demonstration-practical  exercise  combination. 

e*  Facilities.  Equipment,  and  Instructional  Materials.  Each 
instructional  strategy  requires  the  use  of  specific  types  of  facilities, 
equipment,  and  materials.  If  the  required  facilities  are  not  available, 
an  alternative  method  may  be  dictated.  For  example,  if  it  has  been 
determined  that  teaching  machines  would  be  the  most  effective  media  for 
the  presentation  of  a block  of  instruction,  but  the  machines  are  not 
available,  an  alternative  approach  will  be  required. 

f • Ifog,  The  time  available  for  a particular  block  of  instruc- 
tion alao  governs  the  strategy  selected.  The  conference  and  performance 
oaehods  demand  larger  allotments  of  time  than  do  the  lecture  and  demonstra- 
tion oethoda.  If  time  is  extremely  limited,  an  alternative  to  the  most 
effective  method  may  be  required. 

g.  Coats.  The  matter  of  costa  is  of  paramount  importance  in 
any  training  program.  Criteria  relating  to  costs  are  not  separate  and 
distinct  from  other  factors.  Obviously,  time,  facilities,  personnel, 
and  the  like  have  price  tags,  but  there  are  two  items  which  are  important 
enough  to  warrant  aeparate  consideration.  First,  the  cost  of  a strategy 


augt  be  reasonable  when  measured  against  teaching  effectiveness.  Other 
factors  being  equal,  if  the  expected  gains  in  learning  effectiveness  of 
a particular  strategy  do  not  offset  any  additional  coats  Incurred  by  the 
use  of  that  strategy,  a less  costly,  even  if  slightly  less  effective 
instructional  strategy  may  be  dictated.  Second,  savings  in  time,  person 
nel,  or  facilities  must  Justify  the  investment  in  the  strategy.  Here, 
the  point  is  that  an  acceptable  relationship  between  investment  in  the 
strategy  and  savings  in  other  areas  must  exist.  In  sum,  the  cost  of 
the  strategy,  regardless  of  its  effectiveness,  must  under  normal  cir- 
cumstances be  offset  by  savings  in  other  aspects  of  the  training  pro- 
gram. 


B.  INSTRUCTIONAL  METHODS 


1.  The  Lecture  Method. 

a.  Definition,  A lecture  is  a semifomal  discourse  in  which 
the  instructor  presents  a series  of  events,  facta,  concepts,  or  prin- 
ciples, explores  a iroblem,  or  explains  relationships.  Students  parti- 
cipate in  a lecture  mainly  as  listeners.  A lecture  is  basically  a means 
of  "telling"  students  information  they  need  to  know.  This  does  not  mean 
however,  Lhat  all  the  talking  done  by  an  instructor  during  a class  per- 
iod can  be  termed  a lecture.  The  term  must  be  reserved  to  describe  a 
more  formal  discourse  which  is  used  to  achieve  an  instructional  objec- 
tive. 

b.  Uses.  Fundamentally,  the  purpose  of  a lecture  is  to 
Inform.  Hie  instructor  has  Information  which  he  wishes  to  transmit  to 
students  by  means  of  oral  communication.  Some  of  the  more  appropriate 
uses  of  the  lecture  are  as  follows: 

(1)  To  orient  students  to  course  policies,  rule9,  pro- 
cedures, purposes,  and  learning  resources. 

(2)  To  introduce  a subject,  indicate  its  importance,  and 
present  an  overview  of  its  scope, 

(3)  To  give  directions  on  procedures  for  use  in  subsequent 
loarning  activities, 

(4)  To  present  basic  material  which  will  provide  a common 
background  for  subsequent  activities. 

(5)  TO  set  the  stage  for  a demoi.it  vat  ion,  re-  vision,  or 

performance. 

(6)  TO  Illustrate  the  application  of  rules,  principles, 

or  concepts. 

(7)  To  review,  clarify,  emphasize,  or  summarize. 

c.  Advantages . A properly  planned  and  skillfully  delivered 
lecture  is  an  effective  method  when  used  in  appropriate  situations. 

The  following  advantages  of  the  lecture  method  are  some  of  the  reasons 
why  it  la  one  of  the  most  widely  used  meehods  of  instruction. 

(1)  Saves  time.  The  lecture  method  saves  time  because 
the  instructor  can  present  more  material  in  a giv*n  amount  of  time  than 
he  can  by  any  other  method. 
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(2)  Permits  flexibility  of  class  9ize.  The  size  of  a class 
is  limited  only  by  the  size  of  the  classroom  to  be  used  or  the  efficiency 
of  the  public  address  system. 

(3)  Requires  less  rigid  space  requirements.  The  lecture 
can  be  used  effectively  in  any  type  of  training  area,  indoors  or  out- 
doors. The  only  requirement  is  that  the  trainees  must  be  able  to  hear 
the  lecturer. 

(4)  Permits  adaptability.  A skillful  lecturer  can  modify 
or  adjust  his  material,  in  terms  of  sequence,  vocabulary,  and  illustra- 
tions, to  meet  the  needs  of  a specific  group.  This  makes  it  possible  to 
present  content  which  is  appropriate  for  the  educational  level,  training, 
and  past  experience  of  the  class. 

(5)  Permits  versatility.  The  lecture  can  be  used  for 
orientation,  introduction,  review,  clarification,  and  sumnary.  It  can 
be  used  at  any  point  in  a course,  and  it  can  be  combined  easily  and 
effectively  with  any  other  method  of  instruction. 

(6)  Permits  better  control  over  content  and  sequence. 
Because  the  instructor  determines  what  is  to  be  presented  and  the  order 
of  presentation,  the  desired  coverage  and  sequence  can  be  accomplished 
with  little  danger  of  engaging  in  time-consuming  detours. 

d.  Disadvantages. 

(1)  Involves  one-way  connrunication.  The  instructor  pre- 
pares and  presents  the  material.  The  student  sits,  listens,  and  takes 
notes.  Most  lectures  therefore  permit  little  or  no  interchange  of 
idaas  between  the  instructor  and  the  students.  All  ideas  presented  to 
the  class  originate  with  the  instructor. 

(2)  Poses  problem  in  skill  teaching.  The  lecture  method 
is  an  inappropriate  means  of  attempting  to  teach  skills  such  as  equip- 
ment operation, 

(3)  Appeals  mainly  to  one  sense.  Most  learning  takes 
place  through  the  visual  sense.  The  lecture,  even  if  supplemented  by 
training  aids,  appeals  mainly  to  the  auditory  sense.  Unless  the  content 
is  Interesting  and  challenging  enough  to  hold  the  attention  of  the 
class,  the  results  are  likely  to  fall  short  of  the  instructional  goal. 

(4)  Contributes  to  student  passiveness.  During  a lecture, 
students  are  passive.  Their  job  is  to  listen.  Attention  is  difficult 
to  attract  and  retain.  Outside  disturbances,  or  mental  meanderinga, 
easily  and  frequently  distract  the  students  and  render  the  lecture 
ineffective. 

(5)  Poses  evaluation  problems.  If  an  instructor  la  to 
teach,  rather  than  merely  presant  information,  ho  must  be  aware  of 
student  reactions,  misconceptions,  inattention,  and  difficulties,  and 
he  oust  remedy  them  immediately.  The  lecture  method  makes  these  per- 
ceptions difficult.  Most  students  have  acquired  the  ability  to  appear 
attentive,  although  they  may  not  even  be  listening.  The  lecturer 
receives  very  little  feedback,  and  much  of  what  he  doea  receive  is 
often  misleading. 


(6)  Depends  on  the  skill  of  the  instructor.  In  a lecture, 
student  interest  end  attention  oust  be  generated  by  the  instructor. 

The  instructor  nust  plan  carefully,  display  sincerity  and  enthusiasm, 
present  his  material  in  proper  sequence,  use  appropriate  vocabulary, 
employ  affective  speaking  techniques,  be  sensitive  to  the  reaction  oi 
his  audience,  and  modify  his  presentation  on  the  basis  of  class 
response.  Failure  to  do  any  of  these  things  will  result  in  loss  of 
student  attention  and  Interest,  and  failure  to  achieve  the  objectives 
of  the  instruction.  The  ultimata  success  of  a lecture  depends  on  the 
skill  of  the  instructor. 

2.  The  Conference  Method. 

a.  Definition.  The  conference  is  a method  in  which  group 
discussion  techniques  are  used  to  reach  instructional  objectives. 

These  discussion  techniques  Include  questions,  answers,  and  coosnents 
from  the  instructor  in  combination  with  answers,  comments,  and  questions 
from  the  students,  and  are  directed  toward  learning  goals.  Basically, 
there  are  three  types  of  conferences:  directed  discussion,  training 
conferences,  and  seminars.  No  sharp  lines  of  demarcation  exist  between 
any  of  these  forms.  Howevar,  the  objectives  of  the  conference,  and 
the  kind  and  amount  of  student  participation,  determine  when  a directed 
discussion  become#  a training  conference,  and  when  a training  conference 
bectxoes  a seminar.  The  bases  for  these  distinctions  are  as  follows: 

(1)  Directed  discussion.  Here  the  objective  is  to  help 
students  acquire  better  understanding  and  the  ability  ia  to  apply  known 
facts,  principles,  concepts,  policies  or  procedures,  or  to  provide  stu- 
dents with  an  opportunity  to  apply  this  knowledge.  The  function  of  the 
instructor  is  to  guide  the  student  discussion  in  such  a way  that  the 
facts,  principles,  concepts,  or  procedures  are  clearly  articulated  and 
applied. 

(2)  Training  conference,  in  a training  conference,  the 

cSjer--:ve  ie  to  pool  the  knowledge  and  past  experience  of  the  studonta 
».  at  Improved  oi  more  clearly  stated  principles,  concepts,  pol- 

icies or  procedures.  The  topics  discussed  In  a training  conference  are 
less  likely  to  have  pat  answers  than  those  used  In  a directed  discussion. 
The  task  of  the  instructor  ia  to  elicit  contributions  from  the  group, 
baaed  on  past  experiences,  which  have  a bearing  on  the  topic  at  hand. 
Balanced  participation,  then,  la  the  goal. 

(3)  Seminar.  Hie  purpose  of  the  seminar  is  to  find 

an  answer  to  a question  or  a solution  to  a problem.  The  instructor  doea 
not  have  an  answer  or  a solution;  in  fact,  there  ia  no  known  best  or 
correct  solution.  Rather,  he  is  seeking  an  answer  and  uead  the  group  to 
develop  one.  The  primary  functions  of  the  instructor  are  to  describe 
the  problem  ss  he  understands  it  and  to  eucouvage  free  and  full  partici- 
pation in  a discussion  aimed  at: 

(a)  Identifying  the  real  problem, 

(b)  Gathering  and  analysing  data. 

(c)  Formulating  and  testing  hypotheses. 

(d)  Determining  and  evaluating  alternative  courses  of 

aetion. 
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(e)  Arriving  at  conclusions. 

(f)  Making  recotaoendations  to  support  or  arrive  at  a 
solution  or  a decision. 

b.  Uses.  Hie  conference  method  is  a valuable  tool  in  the 
instructor's  kit.  Some  of  the  more  important  applications  of  this 
method  are  as  follows: 

(1)  To  develop  imaginative  solutions  to  problems. 

(2)  To  stimulate  Interest  and  thinking,  and  to  secure 
student  participation  in  situations  which  would  otherwise  allow  the 
data  to  remain  passive. 

(3)  To  emphasize  the  main  teaching  points. 

(4)  To  supplement  lectures,  readings,  or  laboratory  exer- 
cises . 

(5)  To  determine  how  well  students  understand  concepts 
and  principles,  and  to  determine  if  they  are  ready  to  proceed  to  new  or 
more  advanced  material. 

(6)  To  prepare  students  for  the  application  of  theory  or 
procedure  to  specific  situations. 

(7)  To  summarize,  clarify  points,  or  review. 

(8)  To  prepare  students  for  instruction  which  is  to  fol- 
low. 

(9)  To  determine  student  progress  and  the  effectiveness 
of  prior  instruction. 

c.  Advantages . 

(1)  Increases  student  interest.  The  opportunity  to  express 
one's  own  views  and  to  hear  the  opinions  of  others  is  stimulating. 

Interest  is  unuaui. 'ly  high  in  a well-planned  and  skillfully  conducted 
conference. 

(2)  Increases  student  acceptance  and  commitment.  Because 
students  actively  participate  in  developing  the  lesson,  they  tend  to 
accept  the  Importance  and  validity  of  the  concent  and  are  more  deeply 
committed  to  problem  solutions  or  decisions  than  they  would  be  if  the 
content  were  merely  presented  to  them. 

(3)  Uc Hires  student  knowledge  and  experience.  Ihe  con- 
ference method  enables  the  instructor  to  make  effective  use  of  the 
students'  backgrounds,  previously  acquired  knowledge,  and  experiences. 

The  entire  class  and  the  instructor  benefit  from  the  experience  and 
thinking  of  all  students. 

(4)  Results  in  more  permanent  learning.  Learning  takes 
place  in  direct  ratio  to  the  amount  of  individual  participation  in  the 
learning  process.  The  conference  demands  s high  degree  of  student  par- 
ticipation, thereby  promoting  better  and  more  permanent  learning. 

d.  Disadvantages. 

(1)  Requires  highly  skilled  instructors,  the  most  impor- 
tant limitation  is  the  lack  of  top-notch  Instructors  who  are  capable  of 
conducting  true  discussions,  the  conference  is  more  exacting  in  resourca- 
fulnass,  initiative,  and  ability  of  the  instructor,  the  instructor  must 
be  able  to  guide  the  discussion  without  appearing  to  do  so.  Ke  oust  be 
thoroughly  informed  on  ell  aspects  of  the  subject  under  discussion.  The 


Instructor  oust  also: 

(a)  Keep  the  discussion  on  the  track. 

(b)  Minimise  debate  over  unimportant  detail*. 

(c)  Relate  cocaaents  to  topics  previously  discussed, 

(d)  Avoid  reopening  topics  already  discussed. 

(e)  Encourage  and  get  full  participation. 

(f)  Prevent  domination  by  a few  students. 

(g)  Sunmarize  and  clinch  each  topic. 

(h)  Bring  the  discussion  to  a close. 

(2)  Requires  preparation  by  students.  Most  conferences 
require  advance  preparation,  in  the  form  of  reading  assignments , think- 
ing, and  study,  before  the  meeting.  Hie  thoroughness  of  the  prepara- 
tion determines  the  quality  of  the  discussion  and  the  outcome  of  the 
conference.  Little  or  no  instructor  control  can  be  insured  over  the 
quality  or  thoroughness  of  student  preparation.  His  results  In  vari- 
ation among  students  in  their  readiness  to  participate  in  the  confer- 
ence . 

(3)  Limits  content.  He  content  appropriate  for  discus- 
sion is  restricted.  Manipulative  operations,  functions,  procedures,  or 
introductory  material  do  not  ordinarily  provide  suitable  content  tor  a 
conference. 

(4)  Consumes  time.  Relatively  large  blocks  of  time  must 
be  allocated  it  n discussion  is  to  he  profitable,.  Per  this  reason,  the 
conference  is  often  ruled  out  as  an  approach  although  it  may  be  well- 
suited  to  the  subject  and  tbo  class. 

(5)  Restricts  size  of  group.  He  conference  method  can- 
not be  used  effectively  with  groups  larger  than  12  to  15  students 
because  the  opportunity  tor  individual  participation  is  too  limited. 

More  reticent  members  are  likely  to  be  left  out  of  the  discussion  and 
denied  valuable  learning  experience*. 

(6)  Requires  selective  group  composition.  He  members  of 
a conference  group,  in  most  cases,  must  possess  the  proper  background, 
maturity,  and  motivation  It  the  discussion  is  to  be  profitable.  He 
desired  degree  of  participation  is  difficult  to  obtain  If  the  group  is 
composed  of  one  subgroup  which  has  ample  experience  In  the  area  to  be 
discussed  and  another  subgroup  has  extremely  limited  experience. 

3.  He  Demonstration  Method. 

a.  Definition.  A demonstration  is  a method  of  instruction 
where  the  instructor,  by  actually  performing  an  operation  or  doing  a 
job,  shows  the  trainee  what  to  do,  how  to  do  it,  and  through  explana- 
tions, brings  out  why,  where . and  when  it  Is  done.  Usually,  the  trainee 
is  expected  to  be  able  to  repeat  the  Job  or  operation  after  the  demon- 
stration. FV>r  this  reason,  the  demonstration  is  often  used  in  conjunc- 
tion with  another  method.  He  most  common  combinations  are  the  lecture- 
daoonstration  and  the  demons t ration-performance, 

b.  Uses.  He  basic  purpose  of  a demonstration  Is  to  show  how 
something  is  done.  It  should  be  employed  wherever  and  whenever  practi- 
cable. Here  ere  some  of  Its  more  important  applications. 
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(1)  To  teach  manipulative  operations  or  procedures;  e.g., 
how  something  is  done. 

(2)  To  teach  problem-solving  and  analytical  skills. 

(3)  TO  illustrate  principles;  o.g.,  wh£  something  works. 

(4)  To  teach  operation  or  functioning  of  equipment; 
e.g. , how  something  works . 

(5)  TO  teach  teamwork;  e.g.,  how  men  work  together  to  do 

something. 

(6)  To  set  standards  ot  workmanship. 

(7)  To  teach  safety  procedures. 

c , Advantages. 

(1)  Improved  learning.  Students  learn  faster  and  more 
permanently  with  a demonstration.  Hits  is  due  to  several  factors: 

(a)  Demonstrations  make  explanations  concrete  by 
giving  meaning  to  words. 

(b)  Demonstrations  provide  perspective  by  showing 
complete  performance  of  a procedure.  Relationships  between  steps  of  the 
procedure  and  accomplishment  oi  the  objective  'ire  clarified. 

(c)  Demonstrations  appeal  to  several  senses.  Stu- 
dents not  only  see  and  hear  during  a demonstration,  they  are  often  given 
the  opportunity  to  touch  the  equipment. 

(d)  Demonstrations  have  dramatic  appeal.  When  well- 
planned  and  executed,  a demonstration  has  a dramatic  quality  which 
arouses  and  sustains  interest  and  attention. 

(2)  Minimises  damage  and  waste.  Equipment  is  often  dam- 
aged when  trainees  attempt  to  operate  it  without  proper  guidance.  It  is 
also  true  that  material  la  wasted  by  neophytes.  Much  of  this  damage  and 
waste  can  be  prevented  by  the  use  of  demonstrations. 

(3)  Saves  time.  A properly  planned  demonstration  takes 
much  lees  student  tine  than  other  methods.  It  reduces  oral  explanation 
time  and  at  tha  aaae  time  prevents  misunderstandings  concerning  how  a 
system  or  a piece  of  equipment  works. 

(4)  Can  be  presented  to  large  groups.  Claes  aire  is 
limited  onlv  by  the  ability  of  the  group  to  see  the  object  Nsing  demon- 
strated. The  u*e  of  large-scale  nockupe  or  models  makes  it  possible  to 
teach  many  operations  to  targe  classes. 

d.  Disadvantages . 

(1)  Requires  careful  procuration  and  rehearsal.  A demon- 
stration should  set  s standard  of  pertV  mature  for  students.  The  proce- 
dure auat  be  technically  correct  and  must  he  performed  with  a skill 
greater  than  that  expected  os  students.  The  instructor  roust  be  sure 
tha:  hit  equipment  is  in  working  order.  Nothing  fails  as  completely  as 
a demons t rat  ion  that  doesn’t  work. 

(2)  Requires  apecial  classroom  arrangements.  Tha  demonstra- 
tion roots  srust  be  set  up  so  thait  all  students  can  clearly  see  every 
phase  of  the  demonstration. 
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(3)  Requires  equipment  end  aids*  The  equipment,  often 
expensive,  oust  be  taken  out  of  an  operational  setting.  Therefore, 
removal  of  this  equipment  oust  be  offset  by  gains  In  training.  Some- 
times models  or  tsockups  oust  be  purchased  or  constructed.  These  repre- 
sent a rather  costly  investment  of  time,  money,  and  other  resources. 

4.  The  Performance  Method. 

a.  Definition.  A performance  Isa  method  In  which  the  student 
la  required  to  perform  under  controlled  conditions,  the  operation,  skill, 
or  movement  being  taught.  Performance  Is  learning  by  doing.  There  are 
four  baalc  types  of  performance. 

(1)  Independent  practice.  In  this  type  of  performance 
students  work  Individually  and  at  their  own  rates. 

(2)  Group  performance  or  controlled  practice.  Here  stu- 
dents work  together  at  the  rate  set  by  the  Instructor,  step-by-step  and 
"by-Che -numbers. " 

(3)  Coach  and  pupil.  This  method  Involves  pairing  students 
Members  of  each  pair  perform  alternately  sj  (*«..  me  tor  and  student. 

(4)  Team  performance.  Herr,  a group  of  students  perform 
an  operation  or  function  which  Involves  ccawwork. 

b.  Uses . In  general,  the  performance  method  has  the  same 
applications  aa  the  demonstration  method  and  la  used  as  follow-on  Instruc 
tlon: 

(1)  To  teach  manipulative  operations  or  procedures. 

(2)  To  teach  operation  or  functioning  of  equipment. 

(3)  TV*  teach  team  skills. 

(4)  ft*  teach  safety  procedures. 

c.  Advantages. 

(1)  Builds  confidence.  Given  Che  opportunity  to  apply  his 
knowledge  in  a realistic  situation,  the  student  develops  confidence  in 
hia  ability  and  a positive  attitude  toward  the  learning  situation. 

(2)  Increases  learning.  Active  student  participation  is 
maximised.  This  fact,  coupled  with  the  Interest  and  attention  gener- 
ated by  putting  theory  into  practice,  increases  both  the  amount  and  the 
permanence  of  learning. 

(3)  Enables  learning  evaluation.  With  the  performance 
method,  the  instructor  has  an  opportunity  to  observe  the  degree  of 
learning  attained  by  each  student,  to  locate  students  having  difficulty, 
and  to  determine  If  there  have  been  weak  areas  in  the  Instruction. 

(4)  Reduces  damage  and  waste.  Because  performance  is 
guided,  students  are  lea*  likely  to  make  mistakes  which  will  damage 
equipment  or  waste  material. 

(3)  Frooetes  safety.  Guided  performance  makes  It  possible 
to  emphasise  the  proper  method  of  performance  and  enable#  prevention  of 
accident#. 

d.  Disadvantages. 

(1)  Requires  cools  and  equipment.  If  a practical  exer- 
cise is  to  be  conducted,  every  student  must  participate  fully.  There- 
fore, tools  and  properly  functioning  equipment  moat  b«  available  in  suf- 
ficient quantity  for  the  sice  of  the  clasa. 
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(2)  Requires  large  blocks  of  time.  A well-run  practical 
exercise  is  often  time  consuming  in  its  requirements  for  setting  up  the 
room  and  equipment,  and  in  accomplishing  the  actual  setting  up  the  room 
and  equipment  for  individual  or  team  performance  of  the  complete  opera- 
tion. 

(3)  Requires  more  instructors.  Unless  the  class  is  very 
small,  a number  of  qualified  instructors  is  required  to  keep  a constant 
check  on  the  progress  of  each  student,  to  give  assistance  when  needed, 
and  to  evaluate  the  quality  of  the  performance. 

5.  Programmed  Instruction. 

a.  Definition.  Programmed  instruction  is  a method  of  self- 
instruction  in  which  the  student  works  through  a carefully  sequenced 
and  pretested  series  of  steps  leading  to  the  acquisition  of  knowledge 
or  skills  representing  the  instructional  objectives.  The  student  pro- 
ceeds through  the  program  at  his  own  rate,  responds  actively  (or  covertly) 
to  each  step  in  the  sequence,  and  receives  immediate  feedback  on  the 
correctness  of  his  response  before  proceeding  to  the  next  step.  Programs 
are  usually  designed  to  permit  the  student  to  master  the  desired  know- 
ledge or  skills. 

b.  JJses. 

(1)  To  provide  remedial  instruction. 

(2)  To  provide  makeup  instruction  for  late  arrivals, 
absentees,  or  transients. 

(3)  To  maintain  previously  learned  skills  which  are  not 
performed  frequently  enough  to  insure  an  acceptable  level  of  proficiency. 

(4)  To  provide  retraining  on  equipment  and  procedures  which 
have  become  obsolete  or  have  been  replaced  since  the  original  training 
was  given. 

(5)  To  upgrade  production,  administrative,  or  other  types 
of  skills  and  knowledges. 

(6)  To  accelerate  capable  students  and  thereby  enable 
them  to  complete  a course  in  less  than  the  usual  amount  of  time. 

(7)  To  provide  a means  of  insuring  enough  common  back- 
ground among  students  to  profit  from  formal  classroom  work  (advance 
study). 

(8)  To  provide  the  review  and  practice  of  knowledge  and 
skills  needed  to  "set"  the  learning. 

(9)  To  provide  vertical  enrichment  (advanced  work)  or 
horizontal  enrichment  (broader  contact)  in  a content  area. 

(10)  To  control  the  variables  in  a learning  situation  for 
experimental  purposes. 

c . Advantages. 

(1)  Reduces  failure  rate.  Basically,  the  reduction  in 
failure  rate  is  due  to  the  fact  that  programs  are  tested  and  validated 
before  they  are  used.  This  procedure  insures  that  the  program  is  effec- 
tive in  performing  the  instructional  job.  The  self-pacing  feature  of 
the  material  also  helps  because  students  are  exposed  to  the  material 
at  a rate  which  is  appropriate  for  the  individual.  Hie  "forced"  re- 
sponse and  immediate  confirmation  features  guarantee  continuous  atten- 
tion to  the  material,  correct  wrong  responses,  and  prevent  misinterpre- 
tation and  the  practice  of  errors. 
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(2)  Improves  end-of -course  proficiency,  'flu;  pretesting, 
self-pacing,  forced  attention,  and  inuvediate  feedback  features  of  pro- 
grams result  in  better,  more  efficient,  and  more  permanent  learning. 

Urns,  end-of-course  proficiency  is  markedly  increased  by  the  use  of  pro- 
grams . 

(3)  Saves  time.  Hie  rigid  control  over  content  made  possi- 
ble by  the  procedures  used  for  developing,  testing,  and  validating  pro- 
grams prevents  the  introduction  of  unnecessary  content  and  thereby 
reduces  the  time  required  to  learn  the  critical  material.  The  self- 
paeing  feature,  along  with  forced  attention,  decreases  the  teaching  time 
required  and  frequently  results  in  average  time  savings  of  30  per  cent 

or  more  over  conventional  instructional  methods. 

(4)  Standardize  instruction.  The  instructional  content 
and  sequence  of  a program  are  predetermined,  They  ore  not  subject,  to 
the  whims,  preferences,  experiences,  or  biases  of  the  instructor.  Hie 
quality  of  the  instruction  does  not  vary  from  day  to  day  nor  from 
instructor  to  instructor.  There  ia  almost  complete  control  over  the 
content,  the  sequence,  and  the  form  of  student  response  Hence,  instruc- 
tion becomes  standardized  and  can  he  repeated  without  change  at  any  time 
for  any  individual  or  group. 

(b)  Kcqu*  •*$  ~>o  special  facilities.  Programmed  materials 
can  be  used  anywhere  a*  time.  No  specially  equipped  rooms  or  facil- 
ities are  necessary, 

(6)  Provides  for  self-instruction.  Although  under  ordinary 
conditions  programs  arc  not  used  as  substitutes  for  instructors,  they 
can  be  so  used.  Programs  arc  validated  under  conditions  where  they 
alone  do  the  teaching.  Therefore,  they  arc  effective  instructional 
materials  even  if  no  qualified  instructor  is  available. 

(7)  Accommodates  adaptability.  Programs  can  be  designed 
to  accommodate  wide  differences  in  aptitude,  ability,  speed  of  learning, 
prior  training,  and  experience.  Hie  needs  of  individuals,  whether  lor 
more  or  less  exposure,  detail,  or  practice,  can  bo  met.  Hie  size  of  a 
class  is  also  unimportant.  Programs  can  be  used  to  achieve  group  or 
individual  progress, 

(8)  Impvoves  efficiency  and  economy  for  group  or  individ- 
ual instruction.  Hie  self-pacing  feature  and  the  handling  of  large  or 
small  groups  make  for  greater  efficiency  and  economy.  In  addition,  pro- 
frams  free  instructors  from  routine,  repetitive  teaching  tasks,  and 
enable  them  to  spend  a larger  part  of  their  time  on  more  difficult  or 
more  demanding  aspects  of  instruction, 

d.  Disadvantages . 

(1)  Requires  local  or  commercial  preparation.  Although 
the  number  of  available  programs  is  growing  rapidly,  those  programs  which 
may  be  used  locally  are  limited  because  most  programs,  produced  by  comae  r- 
cial  publishers  or  other  military  service  schools,  do  not  match  the 
Instructional  objectives  of  local  courses,  For  this  reason,  programs 
must  be  developed  locally  or  contracted  with  commercial  programing 
concerns. 
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(2)  Requires  lengthy  programmer  training.  Very  few  trained 
programmers  are  available  locally.  The  training  program  is  relatively 
lengthy  and  demanding.  Only  a small  percentage  of  personnel  exposed  to 
programmer  training  will  become  competent  progransners. 

(3)  Increases  expenses.  Programs,  whether  developed 
locally  or  contracted,  are  extremely  costly.  For  local  development  there 
must  be  a large  investment  in  programmer  training  and  an  ever,  larger  one 
in  program  writing,  testing,  and  validation.  Contract  program  develop- 
ment is  expensive  in  terms  of  dollar  outlay,  and  in  terms  of  the  time 
required  by  subject-matter  experts  and  technicians  for  consulting  with 
programmers  and  reviewing  draft  materials. 

(4)  Requires  considerable  leadtime.  Programmed  materials 
cannot  be  selected  or  developed  overnight.  A considerable  amount  of 
leadtitne  is  required  to  screen  and  select  appropriate  programs  from 
those  available.  If  programs  are  developed  either  by  staff  and  faculty 
or  by  contract  programmers,  the  leadtime  for  production,  testing,  and 
validation  is  even  greater.  If  content  is  unstable  or  subject  to  fre- 
quent and  radical  change,  it  is  inappropriate  for  programming. 

(5)  Demands  competent  instructors.  Instructors  must  be 
able  to  motivate  students  to  complete  programs.  They  must  be  able  to 
assist  any  student  at  any  point  in  the  programmed  sequence  at  any  time. 
Mediocre  instructors  cannot  meet  these  requirements.  If  instructors 
are  to  be  able  to  provide  the  motivation,  guidance,  and  assistance 
required  for  the  optimum  use  of  programmed  materials,  they  must  have: 

(a)  Insight  into  the  learning  process. 

(b)  A thorough  understanding  of  the  rationale, 
principles,  construction,  and  use  of  programing  skill  in  conducting 
tutorial-type  instruction  and  individual  counseling. 

(c)  A mastery  of  the  subject-matter  of  the  programs 


used. 


(6)  Requires  mature  students,  Hie  use  of  programs 
requires  a student  group  which  is  mature  enough  and  sufficiently  well 
motivated  to  work  more  or  less  independently.  Furthermore,  they  must 
possess  reading  ability  at  the  level  required  for  full  understanding  of 
the  program. 

(7)  l’oses  administrative  problems.  The  use  of  programmed 
materials  creates  unique  administrative  problems.  Foremost  among  theae 
are  the  scheduling  and  assignment  problems  caused  by  the  self-pacing 
feature  of  programs.  Hits  feature  results  in  different  phase  and  course 
completion  times  with  consequent  difficulties  in  scheduling  following 
instruction  and  assigning  graduates  to  field  units. 


6.  Study  Assignment. 

a.  Definition.  Hie  study  assignment  is  a method  in  which  the 
instructor  assigns  readings  in  books,  periodicals,  manuals,  or  handouts; 
requires  the  completion  of  a project  or  research  paper;  or  prescribes 
problems  and  exercises  for  the  practice  of  a skill.  This  method 
involves  imposing  a task,  providing  for  student  motivation,  and  giving 
general  directions  for  carrying  out  the  assignment.  Implicit  in  this 
method  are  the  problems  of  setting  up  worthwhile  learning  activities. 
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and  anticipating  student  difficulties  and  means  of  overcoming  them.  If 
these  steos  are  not  veil  handled,  the  objectives  of  the  assignment  are 
not  linety  to  be  achieved.  The  study  assignment  has  two  basic  forms: 

(1)  Independent  study.  Here  the  student  carries  out  the 
assignment  without  instructor  assistance  or  direct  guidance. 

(2)  Supervised  study.  In  this  form,  the  student  carries 
out  the  assignment  with  an  instructor  available  for  guidance  and 
assistance. 

b.  Uses. 

(1)  To  orient  students  to  a topic  prior  to  classroom  or 
laboratory  work. 

*2)  To  set  the  stage  for  a lecture,  demonstration,  or 
discussion;  i.e,,  advance  study. 

(3)  To  provide  for  or  capitalize  on  individual  differ- 
ences in  ability,  background,  or  experience  through  differentiated 
assignments. 

(4)  To  provide  for  t..e  review  of  material  covered  in 
class  or  to  give  the  pr>  tice  essential  for  the  development  of  skills 
and  problem-solving  ability;  i.e,,  homework. 

(5)  To  provide  enrichment  material. 

c.  Advantages. 

(1)  In.reases  coverage  o l material.  A far  greater  amount 
of  material,  and  detailed  treatment  of  it,  can  be  covered  in  a shorter 
period  of  time  by  study  at -ilgnments  than  by  any  other  means. 

(2)  Reduces  classroom  time.  Used  properly,  assignments 
can  serve  as  e.  substitute  tor  lectures:  or  by  providing  a common  body  of 
knowledge,  make  lectures,  demonstrations,  and  conferences  more  meaning- 
ful and  more  productive. 

(3)  Improves  learning.  Practice  in  essential  to  the 
development  of  skills.  Assignments  prcvi-e  a means  of  giving  enough 
practice  to  insure  mastery  of  the  skill. 

(A)  Permits  individualized  attention.  Study  assignments 
can  be  designed  to  make  use  of  the  experience,  special  skills,  or 
interests  of  students,  ov  to  remedy  Individual  deficiencies  in  knowledge 
or  skill. 

(5)  Reduces  instructor  interpretation.  Students  may  be 
referred  to  the  original  source  instead  of  being  exposed  only  to  the 
instructor's  interpretation.  This  insures  that  the  content  will  be  pre- 
sented as  intended  by  the  originator  of  the  material. 

d.  Disadvantages ■ 

(1)  Requires  careful  planning  and  followup.  If  students 
arc  not  well  motivated,  they  are  not  likely  to  do  a thorough  Job  with 
assignments,  especially  those,  which  they  must  do  on  their  own.  The 
instructor  must  plan  and  assign  work  in  such  a way  the.  the  objectives 
are  clear,  the  instructions  are  lucid,  and  the  motivation  is  preaent; 
and  ho  oust  follow  up  to  insure  that  the  assignment  has  been  carri'd 
out. 
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(2)  Poses  evaluation  problem.  The  effectiveness  of  study 
assignments  is  difficult  for  an  instructor  to  evaluate.  It  is  also  dif- 
ficult for  him  to  determine  what  went  wrong  with  a study  assignment 
when  results  are  not  as  good  as  anticipated. 

(3)  Results  in  practice  of  errors.  In  skill  development 
it  is  critical  that  the  skill  be  practiced  in  the  prescribed  mode. 
Particularly  with  independent  practice,  there  is  a danger  that  the 
student  will  practice  an  incorrect  procedure  or  error.  When  this 
occurs,  a large  expenditure  of  time  is  required  to  "unlearn"  the  skill 
and  "relearn"  it  correctly. 

(4)  Produces  nonstandard  results.  The  variations  in 
reading  ability  in  any  group  and  the  differences  in  motivation  produce 
varying  degrees  of  learning  when  study  assignments  are  used.  Where 
standardization  of  learning  is  essential,  study  assignments  may  be 
inappropriate. 

7.  Tutoring. 

a.  Definition.  Tutoring,  or  coaching,  is  a method  of 
instruction  in  which  an  instructor  works  directly  with  an  individual 
student.  The  method  may  involve  exposition,  demonstration,  questioning, 
coaching,  or  guided  practice, 

b . Uses. 

(1)  To  teach  highly  complex  skills  and  operations,  or 
operations  which  involve  considerable  danger  to  men  or  hazards  to  expen- 
sive equipment. 

(2)  To  provide  individualized  remedial  assistance, 

c.  Advantages. 

(1)  Permits  adaptive  instruction.  With  a competent 
instructor,  tutoring  provides  the  optimum  in  individualized  instruction. 
The  needs  of  the  individual  student  can  be  diagnosed  and  instruction 
can  be  tailor-made  to  meet  his  unique  needs. 

(2)  Stimulates  active  participation.  In  a tutorial 
setting,  the  highest  possible  degree  of  student  participation  can  be 
achieved.  Direct  involvement  in  the  learning,  by  answering  and  asking 
questions,  by  performing  under  supervision,  is  guaranteed. 

(3)  Promotes  effectiveness.  The  ability  of  the  tutor- 
coach  to  adapt  his  instruction  to  the  needs  of  the  individual,  together 
with  the  high  degree  of  interaction  and  participation  of  the  student, 
make  this  method  extremely  effective  in  achieving  instructional  objec- 
tives. 

(4)  Promotes  safety.  Hie  one-to-one.  instructor-strident 
ratio  provides  close  control  over  performance  of  hazardous  operations, 
resulting  in  the  prevention  of  injury  to  the  operator  or  damage  to  the 
equipment. 

d.  Disadvantages . 

(1)  Requires  highly  competent  instructors.  Tutoring,  or 
coaching,  is  one  of  the  most  demanding  types  of  instruction  to  conduct. 

It  requires  complete  mastery  of  the  content  and  skill  in  diagnosing  and 
remedying  learning  difficulties. 

(2)  Demands  time  and  money.  Tutoring  is  probably  the  most 
expensive  method  of  teaching.  Although  only  one  student  is  receiving 
the  instruction,  instructor  preparation  and  presentation  time  are  essen- 
tially the  same  as  they  would  be  for  a whole  class  of  students. 


8.  Combination  Instruction. 

a.  Definition.  This  is  a method  of  instruction  which  uses  two 
or  more  basic  instructional  approaches  in  combination.  For  example,  this 
method  for  one  lesson  might  include  a study  assignment,  a lecture  in 
which  safety  precautions  in  handling  a piece  of  equipment  are  emphasized, 
a demonstration  by  the  instructor,  and,  finally,  performance  by  the  stu- 
dents . 

b.  Uses . Combination  lessons  can  be  used  to  meet  almost  any 
type  of  instructional  objective  in  any  training  situation.  However,  they 
are  most  appropriate  where  skill  development  is  involved, 

c.  Advantages. 

(1)  Increases  interest.  The  variety  of  approaches  used  in 
a combination  ’esson  make  for  a more  interesting  and  engaging  instruc- 
tional period. 

(2)  Promotes  flexibility.  Hie  use  of  several  approaches 
frees  the  instructor  from  the  restricting  or  limiting  aspects  of  any 
single  method.  He  can  easily  adjust  his  approach  to  the  needs  of  the 
class  and  the  requirements  of  the  situation. 

(3)  Improves  learning.  The  combination  lesson  maximizes 
the  advantages  of  any  single  method.  It  allows  the  Instructor  to  use 
approaches  which  complement  each  other.  This  fact,  plus  the  advantage 
of  higher  student  interest,  results  in  improved  learning. 

d.  Disadvantages. 

(1)  Requires  highly  skilled  instructors.  Instructors  must 
be  able  to  use  all  methods  of  instruction  with  a high  degree  of  skill. 

(2)  Requires  smaller  groups.  The  use.  of  methods  in  com- 
bination requires  closer  control  by  the  instructor  and,  its  concomitant, 
better  supervision  of  student  activities.  To  obtain  the  desired  con- 
trol, classes  roust  be  kept  small. 


C.  TYPES  OF  STUDENT  AND  INSTRUCTOR  ORGANIZATION 


1.  Random  Grouping  and  Assignment. 

a,  Definition.  Random  assignment  of  students  and  instructors 
is  an  organizational  approach  in  which  more  or  less  heterogeneous  groups 
of  students  are  assigned  to  class  sections,  and  the  responsibility  for 
competing  instruction  is  shared  by  instructors  assigned  to  one  or  more 
academic  elements.  Hie  size  of  the  class  is  determined  mainly  by  avail- 
able facilities,  including  such  considerations  aa  seating  capacity  or 
the  number  of  equipment  positions  available.  Qualified  instructors  are 
assigned  usually  on  a change  or  duty  roster  basis, 

A^licatloufi.  Although  there  are  relatively  few  situations 
in  which  random  assignment  should  be  used,  it  can  be  used  under  the  fol- 
lowing conditions: 

(1)  Prerequisites  for  enrollment  in  a course  are  suffi- 
ciently well-defined  and  applied  to  insure  the  assignment  of  students 
who  possess  the  basic  aptitudes,  abilities,  education,  prior  training  or 
experience  essential  to  successful  progress  in  the  course. 


7-16 


(2)  Standards  of  instructor  qualification,  in  terms  of 
both  technical  knowledge  and  teaching  skills,  are  set  high  enough  to 
insure  an  acceptable  level  of  teaching  competence  among  all  instructors. 

(3)  The  content  to  be  presented  is  completely  new  to  the 
students  and  is  presented  primarily  as  an  orientation  or  introduction. 

(4)  The  accomplishment  of  the  objectives  of  the  instruc- 
tion depends  upon  a great  variation  in  the  backgrounds  and  experience  of 
the  students;  e.g.,  some  aspect  of  problem-solving. 

(5)  A wide  range  of  abilities,  aptitudes,  education, 
training,  and  experience  is  of  little  consequence;  e.g.,  introductory 
materials  or  orientations. 

c . Advantages . 

(1)  Simplifies  scheduling.  With  this  system,  scheduling 
and  assignment  of  students  and  instructors  is  relatively  uncomplicated. 

It  simply  involves  matching  classes  with  instructors,  training  space, 
and  equipment.  Variables  which  must  be  taken  into  account  in  other 
forms  of  organization  can  be  ignored. 

(2)  Simplifies  planning.  Although  planning  for  any  sub- 
ject in  a course  cannot  be  undertaken  without  reference  to  other 
blocks  of  instruction  in  the  same  course,  there  is  less  need  for  cooper- 
ative planning  by  all  instructors  under  the  random  system. 

(3)  Permits  appraisal  of  instruction.  Because  each 
instructor  is  largely  responsible  for  the  planning  and  conduct  of 
instruction  in  a specific  content  area,  it  is  relatively  easy  to  identify 
deficiencies  which  result  in  failure  to  achieve  instructional  objec- 
tives. 

d.  Disadvantages, 

(1)  Reduces  flexibility.  With  random  organization,  the 
length  of  instructional  periods  must  be  standard  if  scheduling  diffi- 
culties are  to  be  avoided.  Sometimes,  a 30-minute  period  is  enough  to 
complete  the  instructional  job,  but  if  periods  are  standardized  at  50 
minutes,  the  instructor  must  pad  the  instruction  to  fill  the  time.  At 
other  times,  a 50-minute  period  does  not  provide  enough  time,  and  the 
instructor  must  compress  his  presentation  to  fit  the  time  available. 

(2)  Reduces  attention  to  individual  differences.  Regard- 
less of  the  rigidity  of  prerequisites  for  enrollment  in  any  training 
program,  wide  variations  in  student  aptitude,  ability,  education, 
training,  and  experiences  are  unavoidable.  Although  the  level  of  the 
Instruction  may  he  set  in  terms  of  the  prerequisites,  the  instructor 
will  be  dealing  with  the  mythical  "average"  student.  Hie  level  may  be 
too  high  and  the  pace  too  fast  for  some,  or  it  may  be  just  the  opposite 
for  others. 

(3)  Increases  the  danger  of  gaps,  overlaps,  and  duplication. 
Because  each  lesson  is  planned  and  conducted  mainly  by  one  instructor, 
<tap8,  overlaps,  and  duplication  of  instruction  are  inevitable.  They 

re  difficult  to  identify  and  costly  to  remedy. 
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(4)  Depends  on  instructor  ability.  The  effectiveness  ol 
instruction  varies  with  the  ability  of  the  instructor.  Even  where  a 
minimum  acceptable  standard  of  instructor  competence  has  been  estab- 
lished, there  is  a wide  range  of  expertise  involved.  Yet,  the  effective- 
ness of  the  instructor  depends  mainly  on  his  ability,  acting  more  or 
less  on  his  own,  to  plan  and  conduct  the  instruction.  The  variability 
of  the  groups  complicates  the  problem. 

2.  Homogeneous  Grouping. 

a.  Definition,  A homogeneous  group  is  one  which  is  character- 
ized bv  uniformity  in  achievement,  ability,  aptitude,  background,  educa- 
tion, training,  or  experience.  With  this  type  of  grouping,  students  are 
assigned  to  a class  on  the  basis  of  selection  instruments  or  devices 
which  indicate  that  they  arc  alike  in  specific  attributes,  traits,  or 
abilities.  Although  it  cannot  he  assumed  that  they  are  undiversified 
solely  on  the  selection  factor,  a "narrower  range"  of  diversification 

is  established.  It  should  be  noted  that  a group  composed  of  students 
with  identical  scores  on  an  aptitude  test  will  not  only  be  different 
in  that  aptitude  (because  of  errors  of  measurement)  but  they  will  vary 
almost  as  widely  as  a randomly  selected  group  on  any  other  selection 
factor  (ability,  experience,  prior  training,  etc.). 

b.  Usc9. 

(1)  To  provide  remedial  assistance  to  students. 

(2)  To  provide  a means  of  accelerating  students  who  are 
fast  learners;  and  therefore  enable  them  to  complete  a course  of  instruc- 
tion quicker. 

(3)  To  provide  faster,  more  able,  or  more  experienced  stu- 
dents with  more  advanced  work  in  a subject,  or  broader  contact  with  a 
content  area. 

c . Advantages . 

(1)  Permits  more  suitable  instruction.  The  reduced  vari- 
ability of  the  group  makes  it  possible  for  the  instructor  to  present  con- 
tent and  to  use  strategies  which  are  most  appropriate  for  the  ability, 
aptitude,  education,  training,  or  experience  of  the  group. 

(2)  Allows  faster  and  more  complete  coverage  of  material. 
The  reduced  variability  of  the  group  enables  the  instructor  to  pitch 
his  instruction  at  the  proper  level  and  pace  tor  the  group. 

(3)  Increases  interest  and  participation.  Homogeneous 
groups  are  typically  smaller  than  randomly  selected  groups.  Hiis  makes 
it  possible  to  obtain  greater  individual  attention  and  student  partici- 
pation in  learning  activities. 

(4)  Permits  better  learning  evaluation.  Hie  smaller  num- 
ber of  students  increases  instructor  opportunity  to  evaluate  progress 
coward  learning  goals. 

(5)  Reduces  failure  rate.  Because  instruction  can  be 
given  at  an  appropriate  level  for  the  students  in  a group,  even  if  they 
are  slow  learners,  the  group  can  achieve  the  learning  objectives. 


d.  Dlaadyantagaa, 

(1)  Increase#  expanse.  For  homogeneous  grouping  there  must 
be  an  Investment  of  time  and  money  in  selecting  and  using  screening  tech- 
niques and  devices.  In  addition,  smaller  classes  result  in  smaller 
student-instructor  ratios;  i.e.,  more  instructors  are  required  to  handle 
the  groups. 

(2)  roses  problems  of  grouping.  As  pointed  out  earlier, 
selection  of  students  on  one  basis  of  similarity  does  not  mean  that  stu- 
dents are  similar  in  all  other  traits  and  abilities.  If  a combination 
of  traits  and  abilities  is  needed,  it  is  extremely  difficult  to  achieve 
any  realistic  degree  of  homogeneity . 

(3)  Complicates  scheduling  and  assignment.  The  increased 
number  of  groups  increases  the  scheduling  of  classes  and  the  assignment 
of  students  and  instructors. 

3.  Team  Teaching. 

a.  Definition.  Team  teaching  is  a system  of  organisation 
utilising  a team  of  instructors,  two  to  eight  in  number.  One  member  is 
designated  as  the  team  leader  and  the  others,  who  represent  a range  of 
subject-matter  and  teaching  competencies,  Jointly  plan,  conduct,  and 
evaluate  all  learning  activities  for  a relatively  large  group  of  stu- 
dents. The  total  student,  group  may  be  taught  simultaneously  ior  some 
lessons  and  divided  into  smaller  groups  tor  other  instruction. 

b.  Dees . Team  teaching  can  be  used  with  any  type  content,  at 
any  level,  and  for  any  instructional  purpose.  However,  it  is  primarily 
used  as  follow#: 

(1)  To  handle  large  and  diversified  groups  of  students 

efficiently, 

(2)  To  maximise  the  use  of  available  instructor  knowledge 

and  akllla. 

(3)  To  provide  a means  of  dealing  with  individual  differ- 
ences in  student  achievement,  ability,  aptitude,  educational  level, 
prior  training,  and  experience , 

c . Advantages . 

(1)  Increases  effectiveness  of  instruction.  Improved 
instructional  effectiveness  is  enhanced  by  the  cooperative  planning  ol 
a team  of  instructors,  instruction  by  the  most  technically  qualified 
instructor,  uae  of  the  best  method  for  reaching  the  objective, 
increased  opportunity  for  student  participation,  and  attention  to  indi- 
vidual differences, 

(2)  Promotes  efficiency.  Team  teaching  permits  maximum 
utilisation  of  the  talents  of  instructors.  Instructors  are  assigned 
tasks  which  are  commensurate  with  chelv  technical  knowledge,  experience, 
and  teaching  skills.  Routine  teaching  and  administrative  tasks  can  be 
assigned  to  less  sklllod  members  of  the  team  thereby  reserving  the 
highly  skilled  Instructors  for  move  demanding  instructional  jobs. 
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(3)  Permits  flexibility.  This  system  of  organization  per- 
mits variations  in  both  the  size  of  student  groups  and  in  the  length  of 
instructional  periods.  Students  can  be  regrouped  in  accordance  with 
their  needs.  The  result  is  a degree  of  flexibility  and  responsiveness 
which  is  achievable  with  few  other  approaches. 

d . Disadvantages . 

(1)  Requires  team  planning  time.  Hie  success  of  team 
teaching  depends  or.  the  quality  of  planning.  Time  must  be  available 
prior  to  and  during  the  course  for  coordination  and  planning  by  members 
of  the  team. 

(2)  Requires  teamwork.  Each  instructor  serving  as  a mem- 
ber of  a team  must  be  able  to  work  effectively  with  the  other  members, 
know  his  job,  know  what  other  members  of  the  team  are  doing,  and  be 
able  to  interact  with  the  team. 

(3)  Requires  special  training.  Because  team  teaching  has 
not  been  used  to  any  great  extent  in  military  schools,  the  roles  ol 
team  members  must  be  defined,  and  training  in  performing  these  roles 
must  be  provided  to  each  member. 

4 . Team  Learning. 

a.  Definition.  Team  learning  is  a form  of  organization  in 
which  a group  of  students,  under  one  instructor,  is  subdivided  into 
smaller  groups  or  teams  for  instruction.  Under  the  supervision  of  the 
instructor,  these  teams  engage  in  learning  activities  of  a variety  of 
types  aimed  at  the  development  of  verbal  and  manipulative  skills. 

b.  Uses . Team  learning  can  be  used  as  a means  of  achieving 
many  types  of  instructional  objectives,  for  any  group,  and  with  any 
content.  Primarily,  team  learning  is  used  for  the  following: 

(1)  To  handle  individual  differences  in  student  achieve- 
ment, ability,  aptitude,  educational  level,  prior  training,  and  exper- 
ience. 

(2)  To  teach  tactical  movements  and  team  skills. 

(3)  To  provide  guided  practice  in  developing  verbal  or 
manipulative  skills. 

(4)  To  develop  problem-solving  ability. 

c . Advantages . 

(1)  Increases  effectiveness  of  instruction.  Team  learning 
enhances  the  effectiveness  of  instruction  because  it  employs  a variety 
of  methods,  emphasizes  student  activity,  and  provides  for  individual 

dif  ferences. 

(2)  Promotes  flexibility.  This  form  of  organization  per- 
mits changes  in  the  size  and  composition  of  subgroups  to  meet  the  needs 
of  the  individual.  Time  can  also  be  allocated  to  activities  as  needed. 

(3)  Requires  fewer  instructors.  While  all  activities  of 
the  group  are  planned  with  the  guidance  and  assistance  of  che  instructor, 
the  group  and  subgroups  teach  themselves.  There  is  loss  formal  presenta- 
tion by  the  instructor. 


d.  Disadvantages . 

(1)  Requires  skilled  instructors.  A team  learning 
instructor  must  have  mastery  of  the  subject-matter,  be  proficient  in  the 
skills  being  taught,  and  be  accomplished  in  carrying  out  all  methods  ar. ' 
techniques  of  teaching.  Few  military  instructors  have  had  the  training 
and  experience  required  to  use  this  system  successfully. 

(2)  Produces  nonstandard  results.  The  graduates  of  a 
course  operated  under  the  team  learning  concept  are  likely  to  show  a 
great  amount  of  variation  in  terms  of  job  knowledge  and  proficiency 
because  no  two  students  have  been  exposed  to  identical  content  or* 
learning  experiences. 


D.  MEDIATING  DEVICES 


l . Teaching  Machines . 

a.  Definition. 

(1)  A teaching  machine  is  any  mechanical,  electrical,  or 
electronic  device  which  provides  instruction  to  a student  without  the 
direct  participation  of  a human  instructor.  Devices  of  this  type  sim- 
ulate, in  one  way  or  another,  the  functions  normally  fulfilled  by  a 
teacher.  Thev  contain  instructional  material,  present  it  in  steps, 
provide  a means  tor  the  student  to  respond,  and  they  provide  the  stu- 
dent with  irnnediate  information  regarding  the  correctness  of  his  response. 
In  addition,  some  machines  perform  the  following  functions: 

(a)  Discriminate  the  correctness  of  the  student's 

response, 

(b)  Automatically  advance  the  program. 

(c)  Provide  random  access  to  teaching  frames, 

(d ) Retain  those  t tames  on  which  errors  have  been 
made  lor  further  presentation. 

(e ) Record  and  tabulate  correct  and  incorrect 

responses , 

(f)  Select  and  present  content  based  on  evaluation  of 
previous  responses. 

(gl  Permit  two-way  concnunlcat  ion  between  student  and 

machine . 

(2)  Use  media  used  include  printed  material,  projected 
material,  visual  or  audio  signal,  or  a combination  thereof.  Use  response 
medium  may  be  pencil,  stylus,  typewriter,  key,  lever,  pushbutton,  switch, 
light  gun,  the  spoken  word,  or  any  appropriate  combination. 

b . Uses. 

(1)  To  supplement  other  instructional  methods  of  teaching 
by  providing  a means  of  advance  study,  practice,  remedial  work,  makeup 
instruction,  review,  maintenance  drill,  acceleration,  or  enrichment 
material, 

(2)  To  substitute  tor  conventional  teaching  methods  in 
teaching  tacts,  concepts,  principles,  or  skills,  and  thereby  relieve 
the  instructor  of  repetitive  or  routine  teaching  tasks. 
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(3)  To  control  Instructional  materials  timing  the  develop- 
ment and  validation  stage. 

(4)  To  insure  complete  control  over  the  sequence  of 
instruction,  the  form  of  student  response,  and  the  iranediate  correction 
of  errors. 

c . Advantages . 

(1)  Increases  student  interest.  Cadgetry  is  extremely 
effective  in  engaging  and  holding  student  attention.  Although  prolonged 
use  of  teaching  machines  may  result  in  a deterioration  of  student  inter- 
est, it  occurs  much  slower  than  with  more  conventional  methods. 

(2)  Provides  for  active  response.  With  a machine,  activ- 
ity of  the  learner,  whether  writing,  speaking,  or  manipulating  levers 
and  buttons,  is  insured.  When  the  student  stops  responding,  the 
instruction  stops. 

(3)  Improves  learning,  because  the  material  in  a machine 
is  programmed  and  self-paced,  it  has  the  same  capacity  as  programmed 
instruction  for  reducing  failure  rate,  for  raising  end-of -course  profi- 
ciency, for  reducing  course  completion  time,  and  for  standardizing 
instruction. 

(^*)  Eliminates  instructor  requirement.  A reliable  and 
well-designed  machine  with  a fully  validated  program  does  not  require 
an  instructor.  This  fact  penults  the  use  ot  instructors  for  more  diffi- 
cult and  demanding  types  of  instruction. 

d.  Disadvantages . 

(1)  Increases  expense.  Machines  are  expensive  in  terms  ot 
capital  outlay  and  often  in  terms  of  maintenance. 

(2)  Lacks  appropriate  programs.  There  are  so  many  types 
of  machines  on  the  market , and  so  tew  programs,  that  it  is  difficult  to 
match  existing  programs  and  machines.  Frequently,  it  is  necessary  to 
reproduce  a program  in  a format  acceptable  tor  an  available  machine. 

This  is  an  expensive  and  time-consuming  process. 

(3)  Poses  administrative  problems.  The  problems  of 
scheduling  and  assignment  caused  by  the  self-pacing  touture  ol  program- 
med materials  are  just  as  outstanding  with  teaching  machines  as  thev  are 
with  book  format  programs.  Added  to  these  are  the  unique  storage,  main- 
tenance, and  repair  problems  ot  machines, 

2 . Student  Response  Syst o m . 

a.  Dof lnit ion.  A student  response  system  is  an  electrical  or 
electronic  means  of  establishing  two-way  communication  and  interaction 
between  an  instructional  program  (or  an  instructor)  and  students.  Sys- 
tems of  this  type  are  designed  to  be  used  by  the  classroom  instructor, 
in  conjunction  with  mass  media  such  as  motion  pictures  and  television, 
and  magnetic  tape  recordings,  lectures,  and  demonstrations.  Periodi- 
cally throughout  the  presentation,  each  student  in  the  group  is  simul- 
taneously asked  to  respond  to  questions.  Responses  may  be  recorded  on 
IHM  cards  or  paper  rolls  which  are  automatically  advanced  before  the 
correct  answer  is  given.  Multiple  choice  questions  may  be  handled  hv 
depressing  keys.  In  this  way,  response  data  are  recorded  and  tabulated 


and  the  student  receives  immediate  feedback  from  the  instructor  or  by 
means  of  indicator  lights.  Similarly,  the  instructor  can  have  his 
teaching  effectiveness  inmediately  evaluated,  at  any  time,  by  means 
of  error  counters  or  meters  which  indicate  the  percentage  of  correct 
responses  to  his  questions. 

b.  Uses . Student  response  devices  combined  with  lectures, 
demonstrations,  audio  or  video-tape  recordings,  or  the  mass  media  may 
be  used: 

(1)  To  replace  an  instructor  by  use  of  the  equipment  in 
its  preprogrammed  automatic  mode  which  prerecords  all  audio  and  visual 
stimuli,  including  questions,  and  which  provides  equipment  control  of 
the  presentation. 

(2)  As  an  aid  to  instruction  where  control  over  the 
sequence,  pace,  and  coverage  of  the  material  is  controlled  by  the 
instructor . 

c . Advantages . 

(1)  Improves  instruction.  Because  instruction  is  care- 
fully planned  and  preprogrammed,  it  is  more  effective.  In  addition, 
the  instructor  receives  immediate  and  specific  feedback  from  the  stu- 
dents, as  necessary,  throughout  his  lecture  or  demonstration.  He  can 
then  improve  his  presentation  as  he  proceeds  by  clarifying  points  that 
have  been  misunderstood. 

(2)  Improves  student  learning.  The  requirement  for  per- 
iodic individual  student  responses  to  questions  by  means  of  the  response 
device  enhances  student  attention,  provides  immediate  feedback,  and 
thereby  improves  student  learning. 

(3)  Permits  larger  classes.  The  size  of  the  group  that 
can  he  handled  is  limited  only  by  the  number  of  response  devices 
installed  in  the  classroom. 

(*»)  Allows  tor  standardisation.  In  its  automatic  progressed 
mode,  the  equipment  can  present  the  same  material,  in  the  same  sequence 
to  many  groups  of  students. 

d . Disadvantages . 

(1)  Depends  on  skill  of  instructor.  The  instructor  must 
not  only  be  a highly  skilled  lecturer  or  demonstrator,  he  must  also 
ask  effective  diagnostic  questions,  and  clanfv.  on-the-spot,  any  mis- 
understandings, In  shent,  he  must  be  fluent  and  flexible. 

(?)  Increases  expense.  Because  of  the  expensiveness  of 
these  devices,  rhev  must  be  used  frequently  and  judiciously  to  realise 
an  appropriate  return  t rerj  the  investment. 

03  Requires  instructor  training.  Instructors  ssust  be 
trained  to  insure  that  lectures  and  demonstrations  are  programmed  for' 
effective  presentation,  and  that  questions  arc  properly  framed,  devel- 
oped veil  iu  advance,  3i;d  inserted  at  the  proper  point  in  the  instruc- 
tional sequences. 


3 . Computet -based  Instructional  Systems , 

a,  Dei inition.  A computer -based  instructional  system  consists 
of  a teaching  machine  and  associated  equipment  which  includes  a digital 
computer  as  one  of  its  components.  The  computer  permits  individual 
instruction  of  upwards  of  200  students  simultaneously . The  stimulus  may 
be  on  cathode-ray  tube,  typewriter  printout,  or  audio  signal.  Responses 
may  be  made  by  typewriter,  light  pen,  or  keyboard.  The  computer  may 
have  the  capability  ot  regulating  the  difficulty  of  the  problems,  the 
rate  ot  presentation,  and  the  type  ol  material  presented  based  on  the 
past  performance  of  the  individual.  Aa  the  student  progresses,  the 
speed  and  difficulty  of  the  program  increase  automatically;  if  the  stu- 
dent slows  down  or  exceeds  a predetermined  error  rate,  the  computer 
adjusts  the  program  accordingly.  In  addition,  a record  of  responses 
can  be  maintained.  The  computer  based  system  can  provide  the  ultimate 
in  machine  instruction  by  engaging  the  student  in  a mutually  responsive 
conversation,  communicated  through  a typewriter  keyboard. 

b . Uses . 

(1)  To  teach  students  to  perform  complex  analytical  tasks. 

(2)  To  provide  automated  and  individualized  drill  in 
manual  or  manipulative  skills. 

(3)  Vo  reach  deductive  inference  and  advanced  problem- 
solving techniques  bv  conversational  Interaction  and/or  simulation. 

u . Advantages . 

(1)  Improves  learning.  Che  computer-based  instructional 
system,  because  it  is  sell -paced,  has  the  same  student  learning  advan- 
tages as  programed  instruction  and  teaching  machines. 

(2)  Permits  flexibility.  The  computer  has  the  additional 
advantages  ot  speed  ot  reaction,  ability  to  adjust  the  program  to  the 
individual,  and  the  capacity  to  handle  relatively  large  groups  of  stu- 
dents simultaneously. 

(3)  Increases  learning  speed.  Use  of  a computer -based 
system  speeds  learning  because  it  presents  pertinent  information  to  the 
student  without  t ime-consnraing  detours. 

d . blsadvaot ages . 

(1)  Increases  expense.  Computer-based  systems  are  elabor- 
ate, hence  require  o large  investment  fov  purenase  or  rental  and  tor 
installation  and  aaimenance . 

(s'  S*osm?s  programming  difficulties.  Programs  arc  difficult 
to  design  because  of  their  inherent  complexity,  both  qualified  eocsputor 
prograsssers  and  programed  instruction  programmer  $ are  required  to  develop 
instruct iosnii  mate.' fats,  therefore,  the  development  of  a program  produc- 
tion capability  locally,  or  contractually,  is  required. 

V Ipsed-circuH  television  $vs  tests, 

*-  Definition.  A elosed-e ireuit  television  system  consists  of 
one  or  store  television  c asset- as  (with  associated  control  equipment), 
light vny  equipment,  audio  squipssant , film  chains,  video  tape  recorders, 
a distribution  svstrs  which  makes  ure  of  coaxial  cable  or  microwave  for 


the  transmission  of  picture  and  sound,  and  receivers.  Closed -circuit 
television,  therefore,  is  distinguished  from  broadcast  television  by 
the  method  used  to  distribute  .he  picture  and  sound.  With  broadcast  TV, 
a transmission  distributes  the  signal  in  all  directions. 

b . Characteristics . Closed-circuit  television  (and  video-tape 
recordings)  has  several  characteristics  of  great  significance  for  train- 
ing purposes. 

(1)  It  lias  the  quality  of  indefinite  extension;  that  is, 
once  the  cost  of  production  has  been  met,  instructional  television  can 
be  used  with  as  many  classes,  either  simultaneously  or  sequentially, 
as  there  are  receivers  available. 

(2)  It  communicates  sound. 

(3)  It  is  a visual  medium,  making  it  ideally  suited  for 
showing  objects,  processes,  maneuvers,  and  their  interrelationships. 

(4)  Television  transmits  action;  it  is  a dynamic  medium. 

(5)  It  has  immediacy,  a quality  which  heightens  its 
"real-world”  character  and  adds  to  its  impact. 

(6)  It  is  an  inclusive  medium;  it  can  transmit  nearly  all 
of  the  other  audiovisual  materials;  i.c.,  films,  slides,  charts,  etc. 

c . Uses. 

(1)  To  te;  h operation  and  functioning  of  equipment. 

(2)  To  teach  individual  and  team  skills. 

(3)  To  bring  live  (and  sometimes  dangerous)  demonstrations 
into  the  classroom. 

(4)  To  give  closeup  magnification  of  small  equipment 

parts . 

(.3)  To  compare  objects  simultaneously. 

(6)  To  integrate  films,  graphics,  or  other  training  aids 
into  an  instructional  sequence. 

(7)  Tn  handle  large  groups  at  dispersed  locations  simul- 
taneously . 

(8)  To  repeat  instruction. 

(9)  To  provide  a means  of  exchanging  instruction  (kine- 
scope or  video-tape). 

d . Advantages . 

(1)  Promotes  the  direct  address  technique.  With  instruc- 
tional television  the  instructor  teaches  to  the  camera;  therefore,  every 
viewer,  regardless  of  where  he  is  sitting  in  the  classroom,  is  being 
talked  to  personally.  Research  has  demonstrated  conclusively  that  such 
"eye-contact"  is  one  of  the  most  effective  techniques  for  inducing 
learning. 

(2)  Projects  personality.  Television  projects  personality 
because  of  direct  address  and  the  use  of  closeups.  If  the  TV  instructor 
has  an  effective  and  outgoing  personality,  he  can  make  personal  contact 
with  his  viewers  and  imbue  the  content  with  personal  meaning, 

(3)  Provides  visual  magnification.  The  ability  of  TV  to 
magnify  even  the  smallest  objects  through  closeups  or  microscopic  pro- 
jection is  one  of  its  greatest  advantages.  With  TV  everyone  has  a 
front -row  seat. 
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(4)  Increases  selectivity.  TV  represents  selective 
attention.  It  focuses  the  students'  attention  to  the  screen  and  tends 
to  reduce  the  amount  of  random  attention  so  characteristic  of  conven- 
tional instruction.  TV  is  also  selective  in  that  it  represents  edited 
reality*  A carefully  prepared  lesson,  televised  skillfully,  eliminates 
extraneous  material  and  deals  only  with  significant  instructional 
points  and  the  examples  which  illustrate  them. 

(5)  Promotes  efficiency.  Due  to  the  manner  in  which  TV 
productions  are  planned  and  produced,  they  are  more  efficient  than  con- 
ventional lessons.  A presentation  which  takes  50  minutes  by  conven- 
tional means  can  be  covered  efficiently  in  a 20-30  minute  TV  version. 
Primarily  this  is  because  the  production  is  carefully  planned,  non- 
essential  material  is  deleted,  visuals  are  presented  without  wasted 
motion,  and  the  instructor  does  not  wander  away  from  the  carefully 
rehearsed  script. 

(6)  Strengthens  impact.  TV  presentations  have  more 
impact  on  learners  than  conventional  lecture  or  demonstration.  This  is 
due  partly  to  the  special  technical  capabilities  of  TV  (magnification, 
amplification,  super imposition,  split-screen,  rapid  changes  in  perspec- 
tive, and  the  optimal  integration  of  a variety  of  audio-visual  aids) 
and  partly  to  the  fact  that  the  instruction  is  presented  by  an  expert, 
backed  up  by  a TV  production  team  of  technical  experts. 

(7)  Provides  standardization.  Once  a TV  lesson  has  been 
recorded  on  video-tape  (or  kinescope)  it  can  be  replayed  as  frequently 
as  necessary.  Each  student  is  therefore  exposed  to  the  identical 
instruction. 

e . Disadvantages . 

(1)  Limits  detail.  Whether  the  TV  screen  is  large  or 
small,  it  still  consists  of  only  the  amount  of  detail  which  the  number 
of  lines  and  the  resolution  of  the  receiving  set  can  convey.  This,  at 
best,  is  considerably  less  than  real-life  visibility.  For  this  reason, 
TV  primarily  uses  medium  range  and  closeup  shots.  Long  shots  are  used 
rarely,  and  then  only  for  viewer  orientation.  This  limitation  restricts 
the  amount  of  written  material  presented  and  makes  necessary  the  use  of 
very  simple  charts,  diagrams,  and  other  visuals. 

(2)  Limits  contrast.  Hie  TV  camera  has  difficulty  in 
handling  strong  contrasts;  it  produces  the  best  pictures  when  it  deals 
with  a somewhat  limited  grey  scale.  This  means  that  visuals  and  illus- 
trations must  be  specially  prepared  (or  treated)  for  TV  use. 

(3)  Provides  one-way  communication.  The  most  commonly 
noted  limitation  of  TV  is  the  fact  that  it  is  one-way  communication. 

The  studio  instructor  misses  the  immediate  feedback  from  the  students 
and  the  clues  it  provides  for  pacing,  for  increasing  or  lessening  the 
amount  of  detail,  and  for  repetition  of  difficult  concepts  or  ideas. 

Die  student  ts  likely  to  feel  cut  off  from  personal  communication  with 
the  studio  instructor  because  he  can't  break  in  with  a question  or  ask 
fov  amplification  of  a point. 
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(4)  Instructor  paced.  A TV  lesson  cannot  be  Interrupted, 
slowed  down,  or  speeded  up.  The  pace  is  set  by  the  TV  instructor  for 
the  average  student . It  may  be  too  rapid  for  the  slow  learner  and  too 
slow  for  the  bright  student. 

(5)  Security.  The  presentation  of  classified  material 
requires  special  precautions  and  places  restrictions  on  the  production 
and  viewing  of  materials. 

(6)  Increases  cost.  The  high  installation,  production, 
and  maintenance  costs  make  it  necessary  to  select  carefully  the  instruc- 
tional materials  to  be  presented  by  TV. 


E.  PROCEDURES 


1.  Advance  Preparation.  Hie  process  of  selecting  instructional 
strategics  cannot  be  set  forth  as  a series  of  routine  steps  which  any- 
one can  follow.  Selecting  strategies  involves  so  many  variables  that 
the  process  is  extremely  complex.  Strategy  decisions  therefore  must  be 
based  primarily  on  professional  and  considered  judgment  following  care- 
ful weighing  of  all  factors.  To  do  this  well,  the  instructor  must  have 
a thorough  knowledge  of  methods  of  instruction,  systems  of  organization, 
and  mediating  devices,  to  include  an  understanding  of  their  uses,  advan- 
tages, and  limitations.  For  this  reason,  the  first  step  in  the  selec- 
tion process  is  to  review  sections  A through  E of  this  chapter.  Para- 
graphs 2 and  3 of  this  section  describe  a method  of  arriving  at  a final 
choice  ot  strategy.  It  is  deceptively  simple.  However,  there  are  many 
judgments  involved.  For  this  reason,  the  procedures  must  be  viewed  only 
as  guides.  The  appropriateness  ol  strategies  selected,  even  using  the 
procedures  as  defined,  still  hinges  on  the  quality  of  the  Judgments  made. 

2,  Preliminary  Selection. 

a.  Study  the  performance  objective  for  the  specific  block  of 
instruction  as  entered  on  the  "Performance  Objective  Listing."  Note 
carefully: 

(1)  What  the  student  is  to  he  able  to  do  following  the 

Instruction. 

(2)  The  conditions  under  which  he  must  perform. 

(3)  The  criterion  of  successful  performance. 

b.  Compare  the  behavior  described  in  the  performance  objective 
with  items  !u  through  u in  the  "criteria"  column  of  the  "Guide  to  the 
Selection  of  Instructional  Strategies"  at  annex  A.  When  you  have  found 
the  item  which  most  closely  matches  the  objective  of  your  instructional 
block,  notr  J\e  primary  and  supporting  methods  in  columns  2 and  3 and 
the  organizational  system  identified  In  column  5.  The  mediating  device 
identified  in  column  4 is  not  essential  to  the  use  oi  the  method. 


3 . Final  Selection. 

a.  Procedure . Check  your  tentative  selection  o!'  method  against 
each  of  the  criteria  listed  in  paragraphs  2 through  7 of  the  Guide  to  the 
Selection  of  Instructional  Strategies.  If  the  item  describes  the  type  of 
content  your  instruction  deals  with;  the  type  of  student  you  will  have  in 
vour  class;  the  instructor  considerations  t ha t apply;  or  the  facilities, 
equipment,  materials,  and  time  factors  that  hear;  hut  the  primary  method 
entered  in  column  2 does  not  match  your  original  selection,  go  hack  to  - 
the  objective  and  select  an  alternative  method  from  column  6.  Recheck 
this  method  against  all  applicable  criteria  in  paragraphs  2 through  7. 

b.  Kxamp le , Objective;  Without  using  references,  and  with  a 
time  limit  of  5 minutes,  the  student  must  be  able  to  calculate  the 
resistance  of  a resistor  of  unknown  value  using  Che  Wheatstone  bridge 
circuit . 

(1)  The  "type"  training  objective  in  the  Guide  which  most 
closely  matches  this  objective  is  Criterion  In.  The  primary  method 
recommended  (column  2)  Is  programmed  instruction  (PI)  followed  by  n 
practical  exercise  (column  3).  It  so  happens  that  a program  is  avail- 
able to  teach  this  skill.  Now,  check  paragraph  2 of  the  criteria. 

Items  a,  d,  t,  g,  i,  j,  and  1 apply.  Note  that  for  each  criterion,  PI 
is  either  the  primary  or  an  alternative  method  recommended. 

(2)  Now  check  paragraph  3.  Criteria  b,  c,  d,  and  e apply. 
Again  either  the  primary  or  alternative  methods  include  PI.  Check 
paragraphs  4 through  7 in  the  same  way. 

(3)  Suppose,  however , that  a programmed  course  is  not 
available.  Check  column  6 for  Criterion  In  to  find  the  alternative 
method.  Hie  method  reconmiended  is  a lecture  demonstration  on  closed- 
circuit  television  (kinescope  or  video-tape  recording).  No  such 
recording  is  available.  Hie  second  alternative  is  a combination 
lecture-demonstration-practical  exercise  using  any  grouping.  Hi  is  is 
one  method  you  could  select.  Here  is  where  Judgment  again  enters  the 
picture.  Hiere  are  other  alternatives,  and  all  of  them  must  be  con- 
sidered be tore  a decision  is  made . 
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CHAPTER  8 


SELECTING  AND  PREPARING  TRAININC  AIDS 

A.  INTRODUCTION 


1.  The  Need  for  Training  Aids.  The  basis  for  all  learning  is 
experience,  and  the  most  effective  and  permanent  learning  is  derived 
from  concrete,  direct  experience.  However,  it  is  not  always  possible 
to  provide  first-hand  experiences  for  students.  Often,  the  instruc- 
tor must  resort  to  an  economical  means  of  communicating  facts  and 
ideas,  the  use  of  words  both  spoken  and  written.  Hut,  the  use  of  words 
alone  cannot  provide  the  vivid,  realistic  experience  required  for  opti- 
mal learning.  Words  must  be  supplemented  and  reinforced  by  other  media. 
The  wise  selection  and  proper  use  of  a variety  of  audio-visual  materials 
can  fill  much  of  the  gap  between  verbalization  and  real-life,  direct 
experience.  For  this  reason,  training  aids  are  an  essential  means  of 
increasing  the  efficiency  and  effectiveness  of  training.  Good  train- 
ing aids  reduce  the  number  of  words  required  to  communicate  ideas. 

They  stimulate  interest,  increase  attention,  promote  understanding, 
and  provide  experience  not  obtainable  in  other  wavs. 

2.  Definition.  In  the  broadest  sense,  training  aids  include 
just  about  anything  that  assists  the  instructc  in  conducting  training. 
For  the  purposes  of  this  discussion,  the  items  listed  below,  when  used 
for  training  purposes,  are  classified  as  training  aids. 

a.  Printed  or  Duplicated  Aids.  These  inctuue  books,  manuals, 
pamphlets,  regulations,  directives,  handouts,  and  advance  sheets. 

b.  Graphic  Aids.  Those  include  pictures,  drawings,  illustra- 
tions, photographs,  chalkboards,  bulletin  boards,  easels,  magnetic 
placards,  maps,  charts,  diagrams,  and  flip  charts. 

c.  Three-Dimensional  Aids,  These  include  objects,  globes, 
models,  cutaways,  mockups,  synthetic  trainers,  and  displays. 

d.  Prelected  Aids.  Those  include  slides,  transparencies, 
filmstrips,  and  motion  pictures. 

e.  Auditory  Aids.  These  include  disk  and  tape  recordings. 

3.  The  Selection  and  Use  of  Training  Aids.  Judgment  must  be 
applied  in  the  long-range  and  day-to-day  choice  of  training  aids  and 
in  the  ways  in  which  they  are  used.  The  instructor  must  assume  the 
responsibility  of  Insuring  learning  effectiveness  and  efficiency  by 
selecting  or  developing  training  aids  which  complement  the  basic 
instructional  strategy  chosen  to  accomplish  the  training  objective. 

Each  training  medium  has  certain  advantages  and  limitations,  these 
factors  tnu3t  be  carefully  weighed  before  a final  selection  is  made. 
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a.  Basic  Select  Ion  Guidos.  The  following  general  guides 
shout  it  be  used  in  selecting  training  aids  regardless  of  type: 

(1)  Select  aids  which  fit  the  maturity,  interest,  and 
abilities  ot  the  student  group. 

(2)  Select  aids  which  are  most  appropriate  for  the  par- 
ticular learning  activity. 

(3)  Maintain  a balance  in  the  types  of  aids  selected. 

(4)  Select  aids  which  complement,  rather  than  duplicate, 
other  learning  resources. 

(5)  Avoid  the  over-use  of  aids.  Do  not  use  an  aid  just 
because  it  is  available. 

(6)  The  major  criterion  of  selection  is:  "Will  it 
advance  learning;  is  it  needed?"  A training  aid  must  actually  aid 
training  and  not  serve  as  mere  "eyewash." 

b.  Conditions  for  use  in  tbe  Classroom.  Certain  factors  and 
conditions  tend  to  encourage  the  use  of  training  aids.  Among  these 
conditions  are  the  lot  lowing: 

(1)  Aids  are  available  in  sufficient  variety  and  quantity 
lo  permit  select ivi tv. 

(2)  Technical  advice  and  assistance  for  the  development 
and  use  of  aids  are  readily  .available. 

(1)  Required  equipment  is  available  and  in  good  repair. 

(4)  Tbe  leadtime  required  for  the  fabrication,  procure- 
ment, or  purchase  of  aids  is  minimal. 

(5)  Aids' are  cataloged  and  stored  so  as  to  facilitate  use. 

S.  GUIDES  TO  THE  SELECTION 
OF  TRAINING  AIDS 

1 . Printed  or  Duplicated  Aids. 

a*  Pc  ft  nit  ion.  Printed  or  duplicated  aids  arc.  materials  used 
to  support  instruction  in  tbe  form  of  books,  manuals,  periodicals,  pam- 
phlets, regulations,  directives,  handouts,  or  the  like, 
b.  Uses . 

(1)  To  provide  advance  assignments.  Printed  aids  may  be 
used  to  provide  students  will:  the  background  information  required  to 
pat ( icipate  effectively  in  classroom  learning  activities. 

(2)  To  provide  reference  material.  Printed  aids  may  be 
used  as  a basis  tor  the  preparation  of  reports  or  as  source  material  for 
the  solution  of  a problem. 

(3)  To  provide  review  and  practice  material.  Printed  aids 
nutv  be  used  as  in-class  or  out-of-class  review  or  practice  materials. 

(4)  To  provide  evaluation  method.  Printed  aids  may  be 
vised  as  a means  of  checking  on  the  effectiveness  of  other  learning 
act ivi ties . 
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e.  Advantage a. 

(1)  Effective  organization.  Printed  or  duplicated  aids 
can  be  organized  more  carefully  because  they  are  prepared  considerably 
in  advance  of  use. 

(2)  General  availability.  Large  quantities  of  printed 
materials  usable  in  instruction  are  readily  available  from  large  numbers 
of  military  and  commercial  sources, 

(3)  Economy.  Printed  or  duplicated  aids  are  relatively 

inexpensive. 

(4)  Compactness,,  The  printed  word  condenses  a large 
volume  of  material  or  experiences  into  a small  space. 

(5)  Ease  of  reproduction.  Printed  materials  are  easily 
and  quickly  duplicated  in  the  required  quantity. 

d.  Disadvantages. 

(1)  Possible  unsuitability.  Unless  printed  materials 
are  locally  prepared,  parts  of  the  material  may  be  unsuitable  for  local 
requirements  because  of  the  bias  of  the  writing  or  the  amount  of  detail 
included. 

(2)  No  provision  for  individual  differences.  Printed  or 
duplicated  materials  cannot  be  suited  to  the  abilities,  interests,  or 
backgrounds  of  all  members  of  a student  group. 

(3)  Possible  misinterpretation.  The  extent  to  which  the 
printed  word  conveys  the  intended  idea  depends  upon  the  clarity  and 
comparability  of  the  meanings  which  writer  and  reader  attach  to  the 
terms  used. 

(4)  Nonstandard  learning  outcomes.  The  amount  of  learn- 
ing derived  from  printed  material  is  a function  of  reading  speed  and 
comprehension.  Differences  in  these  skills  within  a student  group  will 
result  in  differing  amounts  of  learning  as  well  as  in  different  comple- 
tion times  for  any  reading  or  study  assignment. 

e.  Selection  Criteria.  Printed  or  duplicated  materials 
selected  or  produced  to  support  instruction  must: 

(1)  Emphasize  content  which  relates  to  and  is  consistent 
with  the  training  objective. 

(2)  Be  free  of  bias  and  ambiguity. 

(3)  Be  presented  in  an  interesting  and  readable  form. 

(4)  Include,  where  applicable,  aids  to  the  reader  in  the 
form  of  indexes,  glossaries,  references,  questions,  or  study  hints. 

2.  Graphic  Aide,  Those  are  materials  which  cormunicnte  facts 
and  ideas  through  a combination  of  pictures,  drawings,  s;rmbols,  and 
words. 

a.  Incidental  Graphics. 

(1)  Definition.  The  term  Incidental  graphics  refers  to 
the  use  of  a chalkboai-d  or  easel  for  printing,  illustrating,  or  drawing 
information  during  or  immediately  preceding  the  presentation  of  instruc- 
tion. 
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(2)  Uses. 

(a)  To  outline  objectives.  The  chalkboard  or  easel 
Is  a convenient  medium  for  emphasizing  the  objectives  and  scope  of  an 
Instructional  block. 

(b)  To  Introduce  technical  terms.  The  devices 
offer  an  easy  and  effective  means  of  teaching  the  spelling,  pronuncia- 
tion, and  definition  of  technical  terminology. 

(c)  To  provide  illustration.  The  devices  provide 
a simple  and  convenient  means  of  illustrating  processes,  objects,  or 
ideas  by  the  use  of  sketches  or  line  drawings. 

(d)  To  record  key  points.  The  devices  can  be  used 
effectively  to  record  progress  and  evolution  of  ideas  in  problem- 
solving and  to  emphasize  the  key  points  in  a discussion. 

(3)  Advantages . 

(a)  Convenience.  Almost  all  classrooms  are  equipped 
with  chalkboards  or  easels,  well-positioned  for  easy  use  by  the  instruc- 
tor. 

(b)  Flexibility.  The  devices  allow  freedom  in 
creating  materials  on-the-spot  and  permit  quick  and  easy  changes  or 
rearrangement  of  materials. 

(4)  Disadvantages. 

(a)  Dependence  on  skill  of  the  instructor.  Although 
the  devices  are  easy  to  use,  this  characteristic  often  results  in  care- 
less use  and  resultant  inefficiency  in  learning. 

(b)  Possible  misinterpretation.  The  background  of 
the  student  determines  the  interpretation  he  makes  of  words,  symbols, 
and  even  drawings. 

(c)  Lengthy  preparation  time.  Extensive  chalkboard 
illustrations  and  listings  require  a great  amount  of  preparation  time. 
Care  should  be  taken  to  insure  lengthy  boardwork  is  prepared  before  each 
class  begins.  The  use  of  other  media  should  be  considered. 

(5)  Criteria.  Materials  placed  on  chalkboards  or  easels 

must  be-. 

(a)  Appropriate  for  the  instructional  objectives. 

(b)  Neatly  and  clearly  drawn  or  printed  so  as  to  be 
clearly  visible  or  readable  to  all  students. 

(c)  Accompanied  by  adequate  explanation  to  avoid 

misinterpretation. 

b . Prepared  Graphics. 

(1)  Definition.  Prepared  graphics  are  printed,  embossed, 
or  photographic  materials  which  eotwnunicate  ideas  clearly  and  forcibly 
in  condensed  form  through  a combination  of  pictures,  drawings,  symbols, 
and  words.  They  include  flat  pictures,  embossograph  placards,  charts, 
maps,  graphs,  and  diagrams. 

(2)  Uses, 

(a)  To  introduce  topics.  Graphics  can  be  used  to 
introduce  new  topics  in  such  a way  as  to  capture  student  attention. 

(b)  To  stimulate  interest.  Well  constructed 
graphics  add  interest  to  a lecture  or  discussion,  and  stimulates  student 
questions. 
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(c)  To  provide  illustration,  Graphics  provide  an 
effective  means  of  illustrating  objects,  procedures,  or  ideas  presented 
in  lectures  or  demonstrations, 

(d)  To  effect  emphasis.  Carefully  selectee  graphics 
focus  attention  on  the  critical  or  important  elements  in  a presentation, 

(e)  To  summarize  topics,  Graphics  are  effective 
summarizing  devices. 

(3)  Advantages. 

(a)  Simplicity.  Quantitative  data  and  complex  rela- 
tionships can  be  presented  simply  and  clearly  by  means  of  graphics. 

(b)  Interest  value.  Graphics  are  inherentlv  more 
interesting  than  verbal  descriptions  or  numerical  tabulations. 

(c)  Economy,  Graphics  are  relatively  inexpensive 
to  procure  or  produce. 

(d)  Flexibility.  Graphics  are  easily  adaptable  to 
many  learning  situations. 

(4)  Disadvantages. 

(a)  Abstract.  Graphics  are  principally  abstract  and 
symbolic.  They  therefore  require  supplementation  by  other  methods  or 
media. 


(b)  Lack  detail.  Graphics  must  focus  on  key  points 
and  dispense  with  detail.  In  some  situations  this  loss  of  detail  may  be 
critically  important. 

(c)  Two-dimensional.  If  depth  is  important  to  the 
learning,  graphics  may  be  completely  unsuitable. 

(d)  "Still"  problem.  Graphics  are  usually  motionless. 
If  motion  is  essential  to  learning,  graphics  may  be  inappropriate. 

(5)  Criteria.  Graphics  used  in  instruction  must: 

(a)  Be  large  enough  so  that  all  students  can  see  them 


clearly. 


(b)  Be  pleasing  in  composition  and  arrangement. 

(c)  Be  accurate  and  truthful. 

(d)  Be  sharp  and  clear  so  that  all  details  are  easily 

distinguishable. 


detail. 


(e)  Avoid  too  much  detail  or  an  insufficiency  of 


(f)  I'se  color  judiciously. 

(g)  Employ  easily  identifiable  symbols. 

(h)  Include  only  essential  data. 


3.  Three -Dime  n.  ional  (3-D)  Aids. 

a.  Definition.  A 3-D  aid  may  be  any  one  of  the  following: 

(1)  Oojccts.  These  are  the  real  thing,  such  as  equipment, 
components,  or  tools  removed  as  units  from  their  normal  setting. 

(2)  Models  or  cutaways.  These  are  recognizable  3-D 
representations  of  real  things. 

(3)  Mockups.  These  are  imitations  of  the  real  thing  but 
do  not  necessarily  involve  similarity  of  appearance. 
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b.  Uses. 

(1)  To  provide  illustration.  Instead  of  merely  talking 
about  an  object,  or  showing  a picture  or  drawing  of  it,  the  actual  objec 
or  a model  is  often  a more  effective  illustration. 

(2)  To  teach  operation  or  functioning.  iTie  use  of  equip- 
ment, tools,  or  instruments  and  processes  is  often  most  effectively 
taught  by  using  the  actual  objects,  models,  cutaways,  or  mockups. 

c . Advantages, 

(1)  Realism.  Three-dimensional  aids  give  depth  and  sub- 
stance to  the  item  under  study  and  thereby  enhance  learning. 

(2)  Simplicity.  Nonessential  elements  of  the  item  can 
be  omitted  or  removed  from  the  aid  so  that  basic  elements  can  be  more 
easily  observed. 

(3)  Adaptability.  Models,  cutaways,  and  mockups  can 
provide  interior  views  of  objects  ordinarily  covered  or  otherwise  invis- 
ible. In  addition,  large  objects  can  be  reduced  in  size  and  small 
objects  can  be  enlarged  to  convenient  size  for  study  and  observation. 

(4)  Emphasis.  Color  and  texture  can  be  added  to  3-D  aids 
to  accent  or  emphasize  important  parts  or  features. 

d.  Disadvantages. 

(1)  Expensiveness.  Models,  cutaways,  and  mockups  are 
expensive  to  construct  and  maintain. 

(2)  Possible  misinterpretation.  Problems  of  clarity  of 
communication,  misunderstanding  of  size,  function,  or  complexity  may  be 
created  by  3-D  aids.  Such  misunderstandings  are  difficult  to  correct. 

(3)  Difficult  storage.  Three-dimensional  aids  are  diffi- 
cult to  catalog  and  require  a considerable  amount  of  storage  space. 

°*  Criteria.  Three -dimensional  aids  used  in  instruction  must: 

(1)  Be  accurate,  and  true-to-life, 

(2)  Re  large  enough  to  be  clearly  visible  to  the  entire 
student  group. 

(3)  Be  as  simple  as  possible. 

(4)  Be  durable. 

4 . Displays  and  Exhibits. 

a.  Definition.  A display  or  exhibit  is  a collection  of 
graphic,  photographic,  or  3-D  aids  grouped  and  displayed  to  accomplish 
a specific  instructional  purpose, 

b . Uses. 

(1)  To  introduce  a subject.  A well-designed  exhibit  or 
displny  is  an  excellent  means  of  stimulating  interest  and  student  moti- 
vation. 

(2)  To  summarize  a subject.  An  exhibit  or  display  can  be 
an  effective  moans  of  providing  a summary  for  a specific  instructional 
block. 

c . Advantages . 

(1)  Interest  value.  Well-designed  displays  and  exhibits 
are  inherently  more  interesting  than  verbal  descriptions. 
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(2)  Flexibility.  Exhibits  and  displays  lend  themselves 
to  almost  any  type  of  content. 

d.  Disadvantages. 

(1)  Time  consumption.  The  design  and  production  of 
worthwhile  exhibits  and  displays  is  time  consuming. 

(2)  Space  allocation.  Adequate  space  in  a desirable  loca- 
tion must  be  set  aside  for  the  exhibit  or  display. 

(3)  Misinterpretation.  Students  may  not  know  what  to 
look  for  in  an  exhibit  or  display,  and  this  problem,  when  added  to  the 
fact  that  the  items  have  been  taken  out  of  their  real-life  settings, 
often  results  in  misunderstandings  that  are  difficult  to  correct. 

(4)  Inconvenience.  Some  things  cannot  be  brought  into 
the  classroom  or  training  area  because  of  size,  safety  considerations, 
or  expense. 

e.  Criteria.  An  exhibit  to  be  effective  must: 

(1)  Have  a single  central  theme. 

(2)  Occupy  a place  of  prominence. 

(3)  Be  left  up  only  long  enough  to  achieve  its  purpose. 

(4)  Be  attractively  arranged,  well  lighted,  and  clearly 

labelled.  ( 

i 

5.  Projected  Aids.  These  are  slides,  transparencies,  filmstrips, 
and  motion  pictures  that  require  a projector  and  screen  for  viewing  by 
the  student. 

a.  Slides,  Transparencies,  and  Filmstrips. 

(1)  Definition.  Slides  are  single  transparent  pictures 
or  drawings  that  can  be  projected  onto  a screen.  They  are  usually  made 
of  photographic  film,  although  sometimes  they  are  etched  on  glass  or 
plastic.  Transparencies  are  large  slides,  usually  7*  x 10"  or  10"  x 10" 
in  size.  Filmstrips  consist  of  a fixed  series  of  individual  slides 
placed  on  a single  strip  of  35mm  film. 

(2)  Uses. 

(a)  To  introduce.  Slides,  transparencies,  or  film- 
strips can  be  used  to  present  an  introduction  and  overview  of  a subject 
or  a process. 

(b)  To  provide  illustration.  The  devices  offer  a 
simple  and  convenient  means  of  illustrating  objects,  processes,  or  ideas. 

(c)  To  summarize.  Filmstrips,  transparencies,  and 
slides  provide  an  effective  means  of  sunmarizing  and  reviewing  content 
previously  taught  by  other  means. 

(3)  Advantages. 

(a)  Convenience.  Slides,  transparencies,  and  film- 
strips can  picture  objects,  events,  and  ideas  that  are  far  away  in  time 
or  space,  enlarge  difficult  to  see  objects,  and  stop  action. 

(b)  Centering  of  attention.  A darkened  or  semi- 
darkened  room  and  a brilliant  screen  focuses  the  attention  of  the  stu- 
dents on  the  instructional  materials. 

(c)  Realism,  Actual  photographs  lend  realism  to 
instruction  only  slightly  less  effectively  than  first-hand  experience. 


(d)  Instructor-paced.  With  slides,  transparencies, 
and  filmstrips  the  illustration  can  be  left  on  the  screen  for  any 
length  of  time  for  study  and  discussion. 

(e)  Ease  of  operation.  Projection  equipment  for 
slides,  transparencies,  and  filmstrips  is  easy  to  operate. 

(f)  Economy.  Films,  transparencies,  and  film- 
strips are  reasonable  in  cost  to  purchase  or  produce. 

GO  Ease  of  storage.  Visuals  of  this  type  occupy 
little  storage  space  and  are  easily  cataloged. 

(h)  Flexibility.  Projected  visuals  are  suited  for 
color  as  well  as  black  and  white  and  they  can  be  used  in  a variety  of 
learning  situations. 

(A ) Disadvantages . 

(a)  Fixed  or  preplanned  sequence.  Sometimes  the 
set  sequence  of  a filmstrip  or  the  preplanned  sequence  of  a series  of 
slides  is  inappropriate.  In  the  case  of  the  filmstrips,  it  is  impossible 
to  change  the  order  of  frames. 

(lO  Equipment  requirement.  Equipment  in  good  repair 
may  not  always  bo  readily  available  and  sometimes  the  equipment  breaks 
down . 

(c)  lack  of  motion.  A still  medium  cannot  portray 
motion  effectively.  If  motion  is  essential,  the  slides,  transparency,  or 
ti lms trip  may  be  inadequate, 

(5)  Criteria . Slides,  transparencies , or  filmstrips  used 
in  instruction  must: 

(a)  Fit  the  training  objective. 

(b)  Avoid  the  inclusion  of  extraneous  material. 

(c)  Be  we  11 -designed. 

(dl  Be  accurate  and  true-to-life. 

(e)  Bo  accompanied  by  appropriate  commentary, 
b . Motion  Pictures . 

(1)  Do t ini i ion.  Motion  pictures  include  black  and  white, 
color,  silent,  or  sound  8mm  or  Ibmm  film  directly  photographed  or  pro- 
duced by  kinescope  recording, 

(2)  Uses. 

(a)  To  introduce  a topic.  Motion  pictures  can  effec- 
tively be  used  to  present  an  introduction  and  overview  of  a subject. 

(h)  To  teach  dlfficult-to-present  material , Motion 
pictures  are  an  effective  means  of  explaining  processes  not  available 
for  direct  observation  because  of  time,  distance,  or  safety.  They  also 
offer  a means  of  presenting  complex  materials,  of  slowing  down  or  speed- 
ing up  processes,  and  of  showing  applications. 

(c)  To  summarize  a presentation.  Motion  pictures 
ran  provide  an  effective  means  of  summarizing  content  presented  pre- 
viously by  other  means, 

(3)  Advantages. 

(a)  Realism.  Motion  pictures  can  bring  remote  events 
into  the  classroom  without  loss  of  realism. 

(b)  Time  savings,  Films  can  substitute  for  field 
trips  thereby  saving  time.  The  condensed  nature  of  a film  production 
also  results  in  time  savings. 
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(c)  Teaching  effectiveness.  The  use  of  sound  and 
motion  increases  interest,  focuses  attention  on  critical  elements  and 
enhances  learning. 

(4)  Disadvantages . 

(a)  Student  passiveness.  With  motion  pictures  stu- 
dents play  a passive  role.  Because  of  darkened  room,  note  taking  is 
kept  to  a minimum. 

(b)  Require  mechanical  aid.  Motion  picture  projec- 
tors, while  not  difficult  to  operate,  are  not  always  available  and  they 
are  subject  to  mechanical  or  electrical  failure. 

(c)  Require  supplemental  methods.  Students  must 
be  carefully  prepared  for  film  viewing  and  some  sort  of  followup  is 
needed  to  insure  learning. 

(d)  Open  to  misinterpretation.  Students  view 
films  in  the  light  of  their  own  experiences.  If  provisions  are  not 
made  for  followup,  misunderstanding  may  be  the  result. 

(5)  Criteria . Motion  pictures  used  for  instruction  must: 

(a)  Fit  the  specific  instructional  purpose. 

(b)  Be  preceded  by  specific  preparation  for  viewing 

the  film. 

(c)  Be  followed  by  appropriate  learning  activities. 

(d)  Be  current. 

6.  Auditory  Aids. 

a.  Definition.  Auditory  aids  include  disk  and  tape  record- 
ing and  their  associated  equipment. 

b.  Uses. 

(1)  To  improve  speech.  Tape  recorders  can  be  used  to 
record,  evaluate,  and  improve  speech  habits,  diction,  voice,  intonation, 
enunciation,  and  general  speech  patterns. 

(2)  in  give  foreign  language  instruction.  Tape  recorders 
and  recordings  arc  an  effective  means  of  building  foreign  language 
speech  and  listening  skills. 

(3)  To  provide  change  of  pace.  Recordings  can  be  used  as 
a change  of  pace  from  one  voice  to  another. 

c.  Advantages. 

(1)  Realism.  Actual  sounds  can  be  reproduced  with  suf- 
ficient fidelity  to  fostor  the  development  of  high  level  discrimination 
skills. 

(2)  Operational  ease.  Recorders  are  easy  to  operate. 

(3)  Inexpensiveness,  Tape  recorders  are  relatively  inex- 
pensive, The  reusability  of  tapes  further  reduces  costs. 

(4)  Flexibility.  Tapes  can  be  used  in  a variety  of  learn- 
ing situations,  singly  or  in  combination  with  other  media,  and  by  indi- 
viduals as  well  as  gvoups.  Contents  of  tapes  are  easily  changed  to  suit 
the  instructional  objective. 
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d.  Disadvantages. 

(1)  Equipment  requirement.  Since  recorders  are  necessary 
they  must  be  in  good  working  order  at  all  times.  Equipment  breakdowns, 
however,  are  quite  common. 

(2)  Possible  misunderstanding.  Particularly  when  used  by 
individuals,  recordings  can  easily  be  misunderstood  or  misinterpreted, 
leading  to  wrong  concepts  or  the  practice  of  errors. 

e.  Criteria.  Recordings  used  for  instruction  must*. 

(1)  Make  a definite  contribution  to  the  achievement  of 
the  training  objective. 

(2)  Be  true-to-life. 


C. 


PROCEDURES 


1.  Preliminary  Analysis. 

a.  Enter  on  Form  IAT  72  (at  annex  A to  this  chapter)  LP  title 
number,  number  of  hours,  POI  title  and  number,  and  recommended  instruc- 
tional strategy.^ 

b.  Copy  the  performance  objective  from  the  POI  in  the  space 
provided.  Study  the  performance  objective  until  you  have  clearly  in 
mind  what  it  is  that  the  student  must  be  able  to  do,  the  conditions 
under  which  he  must  do  it,  and  the  cirterion  of  successful  performance. 
Keep  these  factors  before  you  as  you  select  your  training  aids. 

c.  Analyze  the  student  group  scheduled  for  this  block  of 
instruction  in  terms  of  previous  instruction,  related  training  and 
experience,  acquired  skills,  vocabulary,  level  of  maturity,  and  instruc- 
tion that  will  follow.  Keep  these  factors  in  mind  when  you  select  a 
training  aid. 

d.  Consider  tne  facilities  which  will  he  used  to  conduct 
instruction  in  terms  of  class  size,  time  available  fox'  instruction, 
room  characteristics,  and  equipment  available, 

2 . Tentative  Selection. 

a.  Carefully  review  each  part  of  the  outline  of  content  to 
bo  taught  and  make  appropriate  entries  in  column  1 of  Form  IAT  72. 
lliese  entries  should: 

(1)  Indicate  Che  purpose  and  coverage  of  the  introduc- 
tion. 

(2)  List  the  major  teaching  points  in  abbreviated  fora. 

(3)  Indicate  the  main  point/s  of  the  sutmary  of  the  les- 
son. 
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See  chapter  13  for  definition. 
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b.  For  the  introduction,  teaching  points,  and  summary,  if 
appropriate,  select  a "type"  aid  which  will  supplement,  rather  than 
supplant,  the  method  or  strategy  being  used,  and  enter  the  name  of  the 
type  aid  in  column  2 of  Form  IAT  72;  e.g.,  transparency,  motion  picture, 
model,  handout,  etc.  Before  makins  your  decision,  check  carefully  the 
uses,  advantages,  and  disadvantages  of  each  type  aid  detailed  in  section 
B of  this  chapter. 

3.  Survey  Available  Resources. 

a.  If  a check  of  local  resources  reveals  that  an  aid  of  the 

type  desired  is  available,  get  the  aid  and  study  it  with  these  questions 

in  mind: 

(1)  Does  it  meet  the  objectives’ 

(2)  Does  it  support  the  strategy? 

(3)  Is  it  current  and  accurate.’ 

(4)  Does  it  avoid  extraneous  detail? 

(5)  Is  it  well-designed? 

b.  If  the  answer  to  each  of  these  questions  is  "yes,"  place 

a check  mark  in  column  4 of  Form  IAT  72  for  each  part  of  the  outline  for 

which  a training  aid  is  "on-hand." 

c.  If  the  answer  to  any  one  of  the  questions  is  "no,"  arrange 
with  Training  Aids  Division  to  up-date  or  redesign  the  fabricated  type 
aid. 

d.  If  no  suitable  fabricated  type  aid  is  available,  consult 
with  Training  Aids  Division  to  determine  whether  a suitable  aid  can  be 
fabricated.  Get  answers  to  these  questions: 

(1)  Can  the  teaching  point  be  adequately  visualieed? 

(2)  Can  the  aid  be  made  locally? 

(1)  Is  sufficient  leadtime  aval LMc  for  fabrication  of 

the  aid? 

e.  If  the  answer  to  each  quos  ion  is  "yes  " place  a check 
mark  in  column  4 of  Form  IAT  72  and  prepare  a rough  sketch  or  sample  of 
the  required  training  aid, 

f.  Route  one  cop"  of  Form  IAT  7c , together  *.th  one  copy  of 
each  existing  printed,  graphic . or  projected  aid  .'Chov  than  motion  pic- 
ture f i In  or  filmstrip)  or  the  rough  drafts  or  sketches  of  aids  to  be 
procured,  duplicated,  purchased,  or  fabricated,  as  follows: 

(1)  Chief,  Division  for  check  of  technical  accuracy. 

(2)  Pf  vector , Department  for  check  of  adequacy. 

(3)  Director,  Off)  ' of  Training  literature  for  determina- 
tion of  editorial  and  doctrinal  'rrectness. 

g.  Upon  receipt  of  approved  Farm  IAT  72,  prepare  a Training 
Aids  llork  Request  (DA  Form  1357)  in  triplicate  for  each  aid  to  be  fabri- 
cated and  forward  to  Chief,  training  Aids  Division.  Allow  sufficient 
leadtlne  for  fabrication  of  the  aid. 

h.  Requests  for  Hilita  v and  federal  publications  to  be  used 
as  training  aids  will  be  sub1  itted  through  channels  normally  used  for 
requisitioning  these  publications.  DA  Form  17,  Requisition  tor  Publica- 
tions and  Blank  Forms,  will  e used  for  the  requisitioning.  Allow  suffi- 
cient leadtiae  for  procurement  of  the  aids. 
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i.  Requests  for  books  or  periodicals  to  be  used  as  training 
aids  will  be  submitted  through  channels  normally  used  for  requisitioning 
these  publications.  DO  Form  1150,  Request  for  Issue  or  Turn-In,  will  be 
used  for  the  requisitioning.  Allow  sufficient  leadtime  for  purchase  of 
the  aids. 

j.  Requests  for  reproduction  of  materials  to  be  used  as  train- 
ing aids  will  be  submitted  through  channels  noroaMy  used  for  requesting 
duplication.  DD  Form  844,  Requisition  for  Local  Duplicating  Service, 
will  be  used  for  requesting  the  service.  Allow  sufficient  leadtime  for 
reproduction  of  the  aid. 
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. SUMMARY 


CHAPTER  9 


DETERMINING  EQUIPMENT  REQUIREMENTS 

A.  INTRODUCTION 


1.  Purpoie.  Equipment  of  several  types  is  required  to  conduct 
training  programs  designed  to  develop  job  skills.  If  instruction  is  to 
be  maximally  effective,  the  right  type  of  equipment  in  the  right  quanti- 
ties must  be  available  when  required.  Equipment  is  expensive.  It  also 
requires  a considerable  amount  of  leadtime  for  procurement  and  installa- 
tion. In  addition,  plant  support  (space,  power,  and  environmental  con- 
trol) requirements  which  arise  from  the  use  of  equipment,  require  exten- 
sive laadtime.  Por  these  reasons,  the  precise  quantity  and  kind  of 
equipment  needed  to  support  instruction  must  be  determined  well  in 
advance  of  the  time  it  is  to  be  used.  As  a guideline,  at  the  present 
time  equipment  must  be  determined  accurately  3 to  5 years  in  advance  if 
usable  facilities  are  to  be  available  at  the  time  the  instruction 
begins.  Careful  planning,  the  application  of  standards,  and  close  coor- 
dination between  the  USASATC&S  and  HQ,  USASA,  and  between  academic  ele- 
ments and  the  Office  of  Logistics  are  essential  to  the  timely  and  accu- 
rate determination  of  equipment  requirements.  The  purpose  of  this  chap- 
ter is  to  establish  standards  and  procedures  for  determining  the  types 
and  quantities  of  equipment  required  to  support  training. 

2.  Categories  of  Equipment.  Several  categories  of  equipment  are 
used  in  training.  The  first  type  consists  of  standard  classroom  furni- 
ture, such  as  chair6,  desks,  tables,  and  laboratory  benches.  Standard 
training  aids  equipment,  such  as  projectors,  screens,  tape  recorders, 
chalkboards,  and  easels  comprise  the  second  category.  The  third  cate- 
gory includes  specialised  training  equipment  associated  with  training 
in  a particular  NOS,  Typewriters,  radio  receivers,  recorders,  test 
equipment,  computers,  models  or  mockups  of  these  items,  special  labora- 
tory benches,  and  communication,  noncommunication,  ACOUSTINT,  or  optical 
signal  simulators  are  exaavies  of  equipment  in  this  category.  The  pres- 
ent chapter  deala  exclusively  with  the  third  category. 


8.  BASIC  DATA  REQUIREMENTS 


1.  Five  Critical  Questions.  Before  a decision  is  asade  regarding 
the  types  and  quantities  of  equipment  to  be  procured  for  training,  five 
critical  questions  must  be  answered. 

a.  What  are  the  objectives  of  the  training? 

b.  Should  training  on  a specific  item  of  equipment  or  posi- 
tion be  provided? 


9-1 


c.  What  MOS  should  receive  the  training? 

d.  How  many  technicians  should  be  trained  on  the  equipment 

per  year? 

e.  Where  should  the  training  be  conducted? 


2.  Types  of  Data  Needed.  To  provide  adequate  answers  to  the 
foregoing  questions,  certain  data  must  be  collected  and  carefully 
analyzed.  These  data  are  as  follows: 

a.  Current  Equipment.  Information  regarding  equipment  cur- 
rently authorized  and  in  use  is  of  first  priority.  Specifically,  the 
following  data  must  be  collected: 

(1)  By  type,  equipment  installed  and  in  use  in  operating 
units  and  its  location  by  geographical  area  and  "type  unit." 

(2)  The  purpose  of  the  equipment  and  the  type  of  mission 
it  is  designed  to  support. 

(3)  The  MOS  of  personnel  operating  and  repairing  the 

equipment . 

(4)  The  number  of  positions  of  each  type  Installed 


worldwide . 

b.  Future  Equipment.  Because  equipment  required  to  support 
training  must  be  included  in  the  USASA  Command  Program  (Combined 
Cryptologic  Program  (CCP),  Combined  Intelligence  Program  (CIP),  and 
Force  Structure  Package  III  Program) , the  types  ts nd  quantities  of  needed 
equipment  must  be  determined  5 years  in  advance  of  the  date  of  use. 

This  means  that  forecasts  of  equipment  must  bt  obtained.  These  projec- 
tions must  include  the  following  information: 

(1)  Equipment  by  type  and  its  location  by  geographical 
area  and  "type  unit." 

(2)  The  purpose  of  the  equipment  and  the  type  of  mission 
it  is  designed  to  support. 

(3)  The  MOS  which  will  operate  and  repair  the  equipment. 

(4)  The  number  of  positions  to  be  installed  and  manned. 

c.  Availability  of  Equipment.  For  planning  purposes  it  is 
essential  chat  information  be  obtained  pertaining  rc  the  availability  of 
current  and  future  equipment  and  positions  for  training.  These  data, 
however,  should  not  be  a limiting  factor  to  planning  instruction  until 
it  is  determined  that  what  is  currently  available,  or  programed  to  be 
available  at  the  time  the  instruction  is  to  begin,  cannot  be  changed  to 
conform  with  the  amount  needed  for  optimum  instruction, 

d.  Equipment  Costs.  Some  items  of  highly  complex  equipment 
are  so  expensive  that  training  positions  at  the  School  cannot  be  Justi- 
fied. This  is  particularly  true  in  cases  where  a relatively  small  num- 
ber of  students  is  to  be  trained.  Section  D of  this  chapter  estab- 
lishes cost-pev-student  limits  for  equipment  positions.  To  apply  these 
standards,  information  pertaining  to  equipment  costs  must  be  obtained, 

«•  atudaviv  . Tb  apply  the  cost -per -student  standard* 
referred  co  in  item  d ihowe  requires  accurst*  forecasts  of  student 
input  to  specific  course*.  In  addition,  the  number  of  items  of  equip- 
ment or  positions  vc  |uired  to  conduct  training  is  in  part  a function  of 
the  number  1 4 student*  to  bo  trsined  concurrently.  Therefore,  planning 


for  equipment  procurement  must  be  based  upon  reasonably  accurate  student 
input  forecasts  up  to  5 year®  in  advance.  Specifically,  the  following 
information  is  required  annually  for  planning  purposes: 

(1)  By  quarters,  the  number  of  graduates  required  in  each 

MOS. 

(2)  The  number  of  students  to  be  assigned  to  each  class. 

(3)  The  number  of  classes  that  will  be  in  session  con- 
currently. 

3.  Sources  of  Data.  Some  of  the  data  required  to  determine 
equipment  requirements  is  available  locally;  however,  much  important 
basic  information  must  be  obtained  from  other  sources.  This  means  that 
effective  internal  coordination  and  liaison  with  higher  headquarters 
and  other  agencies  must  be  established.  The  sources  of  these  data  are 
as  follows; 

a.  Current  Equipment  Allocations  and  Usage. 

(1)  Headquarters,  USASA:  DCSLOG. 

(2)  Headquarters,  USASATC&S:  Office  of  Logistics. 

(3)  Job  analysis  schedules  produced  by  USASA  Command  Job 
Analysis  Teams. 

b.  Future  Equipment. 

(1)  Headquarters,  USASA:  Combat  Developments  Activity 
(CDA),  DCSLOG,  and  DCS FOR. 

(2)  USASA  Materiel  Support  Coomand  (USASAMSC). 

(3)  National  Security  Agency  (NSA). 

(4)  Headquarters,  USASATC&S:  Office  of  Training  Litera- 
ture. 

c . Equipment  Availability  and  Costs. 

(1)  Headquarters,  USASA:  DCSLOG. 

(2)  Headquarters,  USASATC&S:  Office  of  Logistics. 

d.  Student  Input ■ 

(1)  Headquarters,  USASA:  DCSPER  and  DCSFOR. 

(2)  Headquarters,  USASATC&S:  Office  of  Plans  and  Pro- 

grams. 

(3)  Headquarters,  USASATC&S:  Scheduling  Branch,  Office 
of  Academic  Operations. 

(4)  Headquarters,  USASATC&S:  Office  of  Personnel  and 
Administration. 

C.  SELECTING  TRAINING  EQUIPMENT 


1.  Primary  Factors  to  Consider . Once  a decision  has  been  made 
to  conduct  training  locally  on  specific  equipme  l or  positions,  the 
types  and  quantities  of  equipment  required  must  be  determined.  Several 
factors  oust  be  weighed  carefully  before  Position  Deployment  Schedules 
are  changed  and  requisitions  for  equipment  are  submitted.  The  following 
factors,  therefore,  must  be  considered. 

a.  Training  Objectives.  The  fundamental  consideration  in  tha 
selection  of  equipment  is  the  objective  of  the  training.  Where  the 
objective  of  che  instruction  is  to  teach  nomenclature  or  simple  identifi- 
cation, no  actual  equipment  may  be  required;  a training  aid  may  suffice. 
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However,  if  the  objective  is  to  develop  operator,  maintenance,  or  repair 
skills,  equipment  of  some  type  will  be  required.  Training  equipment  may 
be  installed  in  two  types  of  configurations  depending  upon  the  objectives 
of  the  training. 

(1)  Field  configuration.  In  cases  where  job  performances 
must  be  developed  under  conditions  identical  to  the  field  environment, 
actual  equipment,  in  the  configuration  used  in  field  units,  must  be  used 
for  training.  For  example,  if  a technician  must  be  able  to  operate 
equipment  in  the  limited  space  of  an  Armored  Personnel  Carrier  (APC),  a 
fully  equipped  APC  oust  be  available  for  training. 

(2)  Training  configurations. 

(a)  Expanded  configuration.  Training  is  very  often 
facilitated  when  a field  configuration  is  installed  in  a manner  which 
permits  either  easier  access  to  components  or  simultaneous  training  of 
several  students.  In  this  case,  field  configurations  are  modified  and 
components  may  be  disarrayed  for  easy  observation,  access,  examination, 
etc. 

(b)  Fragmented  configuration.  Where  training  ia 
given  only  on  the  main  components  of  a field  configuration,  a training 
position  may  consist  of  the  major  components,  complete  with  intercon- 
necting cables,  but  without  ancillary  equipment  such  as  antennas  and 
generators. 

(3)  Teaching  Systems  equipment.  This  is  equipment  used 
to  present  instructional  material  to  the  student;  i.e.,  it  is  not  used 
as  a training  aid.  Examples  of  this  type  of  equipment  are  simulators, 
EDEX  teaching  system,  simplex,  and  closed-circuit  television. 

b.  Instructional  Strategy.  The  instructional  strategy  used 
to  achieve  the  training  objective  has  a direct  bearing  on  the  types  and 
amounts  of  equipment  needed.  Different  instructional  strategies  may 
require  different  types  of  equipment.  Hut,  regardless  of  which  strategy 
Is  used,  the  basic  purpose  of  the  equipment  is  to  support  the  objectives. 
Equipment  that  is  too  simple  or  too  sophisticated  will  not  support  the 
instruction.  Individual  performance  may  require  more  equipment  than 
team  performance . Both  performance  strategies  require  more  equipment 
than  the  demonstration  method. 

c.  Student  Population.  The  number  of  students  in  a class  and 
the  number  of  classes  taught  concurrently  determine,  in  part,  the  number 
of  pieces  of  equipment  required  to  support  the  instruction.  Hie 
Detailed  Schedule  of  Claeses  provides  the  student  input  data  needed  to 
determine  the  amount  of  equipment  required. 

2.  Limiting  Factors.  Section  Cl  identifies  the  basic  considera- 
tions used  in  determining  the  type  and  quantity  of  training  equipment 
required.  Standards  based  exclusively  on  these  factors  would  result  in 
an  ideal  training  situation.  Unfortunately,  compromises  may  often  be 
necessary  because  of  certain  limiting  factors.  These  factors  are  as 
follows: 
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*.  training  Area  and  Facilities.  Limitation#  on  the  type  and 
quantity  of  equipment  are  often  impoaed  by  shortfalls  in  providing 
space,  power,  and  air-conditioning  requirements.  These  shortfalls 
result  from  inadequate  leadtiae  and  lack  of  funds,  these  factors  may 
restrict  equipment  in  terns  of  kind,  number,  and  configurations. 

b.  Safety  Requirements . Special  consideration  must  often  be 
given  to  safety  requirements  in  determining  both  the  kind  of  equipment, 
the  number  of  positions,  and  their  physical  layout  or  arrangement, 
these  factors  are  often  crucial  in  determining  student -equipment  ratios. 

c.  Security  Requirements.  Classified  equipment  requires  spe- 
cial handling  and  security  precautions,  there  are  limits  imposed  on  the 
location  of  such  equipment;  that  is,  classified  equipment  that  must  be 
installed  in  secure  areas. 

d.  Availability.  Often  there  are  limits  on  the  number  of 
items  of  equipment  available.  Sometimes,  requirements  of  operating  units 
must  be  met  before  equipment  positions  can  be  made  available  for  train- 
ing. This  dictates  higher -than-desirable  student -equipment  ratios,  extra 
training  shifts  (night  classes),  changes  in  scheduling,  rotation  of  stu- 
dents, simulation  of  equipment  by  the  use  of  models  and  mockups,  or  the 
use  of  older  models  of  the  equipment. 

e.  Costs . The  investment  in  equipment  represents  a very 
large  part  of  the  total  training  budget.  As  noted  earlier,  some  items 
of  equipment  are  so  expensive  that  procurement  of  positions  in  the  num- 
ber indicated  by  the  standards  may  be  impossible  to  justify.  It  may 
sometimes  be  necessary  to  settle  for  fewer  pieces  of  equipment  than  the 
ideal  student -equipment  ratio  would  normally  Indicate  in  order  to  keep 
costs  at  a reasonable  level. 


D.  STANDARDS  FOR  DETERMINING 
TRAINING  EQUIPMENT  REQUIREMENTS 


1.  Knockout  Standards.  There  are  four  factors  which  will  deter- 
mine whether  or  not  training  will  be  conducted  on  an  item  of  equipment 
at  the  School.  These  are  cost-per-student,  universality  of  equipment 
allocations,  9tudent  input,  and  equipment  utilization.  If  any  of  these 
factors  is  below  the  standard,  training  on  the  equipment  must  be  con- 
ducted elsewhere. 

a.  Cost  per  Student.  Because  the  cost  of  equipment  may 
exceed  an  amount  which  can  be  justified,  maximum  cost  standards  must  be 
established  and  applied.  This  means  that  when  costs  exceed  the  maxi- 
mum, training  on  the  equipment  will  ordinarily  be  conducted  at  a loca- 
tion other  than  the  School  (by  the  manufacturer,  at  NSA,  or  at  the 
operating  unit  on  the  Job),  unless  the  local  conduct  of  such  training  is 
directed  by  higher  headquarters.  The  cost-per-student  index  has  been 
selected  because  the  procurement  of  expensive  equipment  msy  be  Justified 
by  the  number  of  students  to  be  trained  annually.  As  an  interim  standard, 
a maximum  cost  per  student  is  established  at  $5,000.  This  index  is 
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computed  by  dividing  the  actual  cost  of  the  equipment  or  po^itLon,  or 
the  cost  of  fabricating  a model,  toockup,  or  simulator,  by  the  annual 
student  input  to  courses  in  which  the  training  equipment  will  be  used. 

b.  Universality  of  Equipment  Allocations.  It  would  be 
extravagant  in  terms  of  both  time  and  equivalent  costs  to  train  all  per- 
sonnel of  a specific  MOS  to  operate,  main-  =»i.n,  -.t  repair  sophisticated 
or  costly  equipment  that  is  unique  to  a particular  unit  or  location. 

For  this  reason,  an  arbitrary  cutoff  of  30  percent  is  hereby  established 
as  an  interim  standard  to  be  applied  in  determining  whether  a specific 
item  of  equipment  is  to  be  procured  for  School  training.  This  means 
that  for  the  MOS  concerned,  at  least  30  percent  of  the  units  to  which 
the  man  might  be  assigned  must  have  the  equipment  installed.  A smaller 
percentage  will  indicate  that  the  training  must  be  conducted  by  the 
manufacturer,  at  NSA,  or  on  the  job  at  the  unit. 

c.  Student  Input.  Because  student  input  is  a function  of 
equipment  cost  per  student,  and  because  even  relatively  low  equipment 
costs  cannot  be  justified  for  small  trainee  groups,  standards  based  on 
student  input  alone  must  be  set.  Therefore,  a minimum  of  50  students 
per  year  is  hereby  established  as  an  interim  standard  to  be  applied  in 
determining  whether  highly  specialized  equipment  should  be  procured. 

d.  Equipment  Utilization.  Training  equipment  may  meet  the 
standards  pertaining  to  cost  per  student,  unit  allocation,  and  student 
input  and  still  represent  an  unjustifiable  cost  because  of  extremely 
limited  instructional  utilization.  Therefore,  as  an  interim  standard, 
equipment  procured  for  training  must  have  a predicted  annual  average 
utilization  of  80  man-hours  per  student  enrolled  in  courses  using  the 
equipment  for  instructional  purposes. 

2.  Selection  Standards.  Once  it  has  been  determined  that  train- 
ing on  a specific  item  of  equipment  at  the  School  can  be  justified,  the 
next  consideration  is  to  determine  types  of  equipment  required.  As 
noted  earlier,  training  effectiveness  must  be  achieved.  This  can  be 
attained  only  by  selecting  equipment  which  complements  the  training 
objectives  and  the  instructional  strategy.  The  following  general  stand- 
ards ahould  be  used  in  selecting  equipment: 

a.  Appropriate  for  the  Learning  Activity.  The  equipment 
used  for  training  must  be  appropriate  for  the  particular  learning 
activity.  For  example,  if  the  objective  of  the  learning  activity  is  to 
build  skill  in  operating  a piece  of  equipment,  the  actual  equipment, 
rather  than  a model  or  mockup  should  be  used. 

b.  Complements  Other  Learning  Resources,  live  equipment  must 
complement  rather  than  duplicate  other  learning  resources.  For  example, 
a mockup  of  an  equipment  position  should  not  be  fabricated  if  opera- 
tional or  training  positions  are  available  in  sufficient  numbers  to  meet 
requirements . 

c.  Currently  in  Use  in  the  Field.  Equipment  currently  in  use 
in  the  field  units  must  be  selected.  With  few  exceptions,  equipment  and 
positions  which  are  no  longer  used  in  operating  units  should  not  be  used 
for  training.  The  exceptions  include  cases  where  only  minor  modifica- 
tions have  been  made  to  equipment  which  would  not  pose  problems  of  trans- 
fer of  training. 
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d.  Realistic . If  simplified  equipment,  simulator*,  mockupa, 
or  models  are  used,  they  must  be  realistic.  For  example,  if  a mockup 
of  a piece  of  complex  and  expensive  equipment  is  used,  the  layout  and 
configuration  of  the  mockup,  control  panels,  and  the  like  must  be  exact 
representations  of  the  real  item. 

e.  Essential  to  Training.  Only  that  equipment  which  is 
essential  to  the  conduct  of  proper  training,  and  only  in  the  amounts 
required  to  handle  the  student  input  efficiently,  should  be  procured. 

In  cases  where  a model  or  mockup  will  do  the  training  job,  and  the 
cost  is  less  than  that  of  the  actual  equipment  (both  for  fabrication 
and  maintenance),  the  substitute  should  be  used. 

3.  Quantity  Standards  (student -equipment  ratios).  The  number  of 
items  of  equipment  required  to  conduct  training  efficiently  can  be  sub- 
stantially reduced  by  the  rotation  of  groups  and  classes  and  by  careful 
scheduling  of  classes.  For  this  reason,  the  standards  established  in 
the  subparagraphs  that  follow  are  maxlmums. 

a.  Lecture/Demonstration.  For  a lecture  or  demonstration 
involving  only  equipment  recognition,  nomenclature,  and  technical  char- 
acteristics, one  item  of  equipment  or  position  to  be  described  or  dem- 
onstrated per  class  in  session  concurrently  is  the  maximum.  (Note:  the 
possibility  of  using  some  type  of  training  aid  should  be  carefully 
studied  before  the  actual  equipment  or  a mockup  is  requisitioned.) 

b.  Demonstration.  For  demonstration  of  the  operation  of 
equipment,  one  item  of  the  equipment  or  one  position  per  class  in  ses- 
sion concurrently  is  the  maximum. 

c.  Individual  Performance.  For  performance  of  individual 
skills,  one  item  of  equipment  or  one  position  per  student  receiving 
instruction  concurrently  is  the  maximum. 

d.  Team  Performance.  For  performance  of  team  skills,  one 
item  of  equipment  or  position  per  team  receiving  the  instruction  con- 
currently is  the  maximum. 


E.  PROCEDURES 


l.  Current  Requirements.  For  MDS  which  have  been  Job  analyzed, 
the  following  procedures  will  be  used. 

a.  Types  of  Equipment  Required. 

(1)  Chief,  Evaluation  Unit  will  apply  the  standards 
found  in  section  C,  paragraph  1 to  determine  the  specific  equipment  or 
positions  on  which  instruction  will  be  provided  at  the  USASAIC&S. 

These  requirements  will  be  reflected  in  the  Performance  Objective  Work- 
cards  forwarded  to  the  responsible  academic  elements  following  the  com- 
pletion of  Job  analysis  and  the  selection  and  writing  of  performance 
objectives. 
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(2)  Upon  receipt  of  the  Performance  Objective  Workcards, 
the  responsible  academic  element  will  select  and  sequence  course  con- 
tent (chapter  6)  and  select  instructional  strategies  and  training  aids 
(chapters  7 and  8). 

(3)  Next,  the  responsible  academic  element  will  check 
the  Performance  Objective  Workcards  to  determine  exactly  what  type  of 
equipment  is  to  be  used  in  training. 

(4)  Then,  the  objectives,  strategy,  and  equipment  listed 
on  the  Performance  Objective  Workcard  will  be  matched  against  the  selec- 
tion standards  defined  in  section  D,  paragraph  2a  through  e.  This  anal- 
ysis will  culminate  in  the  selection  of  a "type"  configuration  for  the 
equipment.  (See  section  C,  paragraph  la.) 

(5)  The  responsible  academic  element  will  then  submit  a 
request  to  Director  of  Logistics  for  acquisition  and  installation  of 
the  equipment.  This  request  must  include  all  the  information  available 
on  the  need  for  equipment  so  that  the  Director  of  Logistics  can  justify 
the  new  requirement  to  Headquarters,  USASA. 

(6)  Upon  receipt  of  the  request,  the  following  actions 
will  be  taken  by  the  Director  of  Logistics. 

(a)  Review  the  requirement  to  Insure  that  the 
request  is  logically  presented  and  complete. 

(b)  Conduct  a technical  review  of  the  configurations 
requested  to  insure  that  they  will  meet  the  instruction  mission  require- 
ment and  that  they  are  technically  feasible. 

(c)  Review  the  equipment  list  to  insure  that  it  is 
complete  and  correct.  Convert  equipment  list  into  a programned  bill  of 
material  (BOH).  A BOM  is  devised: 

JL  By  a project  officer  in  DCSLOG,  HQ,  USASA. 

2.  By  a change  to  a current  ASA  BOM:  proposed 
by  instructional  element  and  processed  by  Director  of  Logistics, 
USASATC&S. 


By  making  a new  BOM  based  on  proposal  of  an 
instructional  element  an’  processed  by  Director  of  Logistics,  USASATC&S. 

(d)  Assign  a position/facility  designation,  if  appli- 


cable. 


(e)  Prepare  an  Installation  Bulletin  for  the  proposed 
configuration,  if  applicable. 

(f)  Prepare  a command  letter  to  HQ,  USASA  requesting 
changes  to  Position  Deployment  Schedule,  BOM,  and  TA  32-1.  An  Installa- 
tion Bulletin  will  also  be  requested,  if  applicable. 

(g)  Subsequent  to  the  receipt  of  approval  from  HQ, 
USASA,  the  Director  of  Logistics  will  provide  appropriate  instructions 
through  the  Director  of  Instruction  and  department  directors  to  chief 
instructional  divisions,  for  requisitioning  of  equipment. 

b.  Quantity  of  Equipment.  To  determine  the  quantity  of  equip- 
ment required  to  support  a course  of  instruction,  a detailed  analysis  of 
the  POI  and  its  component  lesson  plana  must  be  made.  A sample  analysis 
is  attached  as  annex  A,  p 9-11.  The  procedure  Is  as  follows: 
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(1)  In  sequence,  identify  eech  lesson  plan  and  criterion 
teat  requiring  equipment  and  enter  the  lesson  plan  or  test  number  in 
column  1 of  annex  A. 

(2)  Enter  the  time  allocation  for  each  lesson  plan  and 
test  entry  in  column  2 of  annex  A. 

(3)  In  column  3,  enter  the  instructional  strategy, 
Including  criterion  tests,  involving  the  use  of  equipment. 

(4)  Using  the  standards  defined  in  section  D2  above, 
enter  in  column  4 the  number  of  items  (or  positions)  and  the  military 
designations  of  each  item  of  equipment  required. 

(5)  From  the  Detailed  Schedule  of  Classes  determine  the 
number  of  classes  that  will  be  in  session  concurrently. 

(6)  Using  these  data  and  the  analysis  found  at  annex  A, 
determine  the  total  number  of  items  of  equipment  of  each  type  required. 
With  complex  course  schedules,  the  use  of  equipment  and  space  must  be 
programmed  graphically  to  simplify  the  process  of  determining  the  num- 
ber of  items  or  positions  required.  Annex  B provides  a sample  graphic 
program.  Annex  C shows  how  the  total  equipment  requirements  are  com- 
puted for  MOS  000  under  the  conditions  defined  in  annexes  A and  B. 

c.  Compromises . Sometimes  it  will  be  impossible  to  achieve 
the  ideal  in  terms  of  type  of  equipment,  configuration,  or  quantity. 

Lack  of  space,  power,  or  other  facilities  and  unprograsmed  increases  in 
student  input  may  dictate  an  arrangement  which  is  not  the  ideal.  In 
such  instances,  the  director,  responsible  academic  department  will  iden- 
tify all  alternatives,  such  as  increased  student /equipment  ratios,  shift 
scheduling,  rotation  of  students,  or  use  of  mockups,  and  select  the  most 
advantageous  alternative. 

2.  Future  Requirements. 

a.  Director,  Office  of  Training  Literature  will  establish  and 
maintain  liaison  with  NSA,  HQ,  USASA  Combat  Developments  Agency,  DCSLOG, 
DCSPOR,  and  the  USASA  Materiel  Support  Ccnsand  to  obtain  forecasts  relat 
ing  to  equipment  changes.  Quarterly  reports  will  be  forwarded  to  the 
Assistant  Commandant  with  information  copies  to  Chief,  Evaluation  Unit, 
Technical  Consultant,  Director  of  Instruction,  and  the  Director  of  Logls 
tics.  These  reports  will  describe  projected  changes  in  equipment  and 
their  possible  Impact  on  MOS  producing  courses.  The  factors  described 
in  section  C,  paragraphs  2b,  c,  and  d apply. 

b.  Director  of  Logistics  will  also  maintain  liaison  with 
DCSLOG,  HQ,  USASA  to  obtain  equipment  forecasts  and  submit  reports  ss 
required  to  the  Assistant  Commandant  with  Information  copies  to  Director 
Office  of  Plana  and  Programs,  Director,  Office  of  Training  Literature, 
Chief,  Evaluation  Unit,  Technical  Consultant,  and  the  Director  of 
Inatruction. 

c.  Annually,  during  the  month  of  September,  Director  Office 
of  Plans  and  Programs  will  obtain  from  DCSPBRS  and  DCSFOR,  HQ,  USASA 
forecasta  of  student  Inputs  for  each  MOS  course  for  the  succeeding 
5-year  period.  These  forecasts  will  be  forwarded  through  the  Assistant 
Commandant  to  Chief,  Evaluation  Unit,  the  Director  of  Inatruction,  and 


each  department  director.  At  this  tine,  a Detailed  Schedule  of  Classes 
for  the  next  fiscal  year  will  be  developed,  published,  and  distributed 
by  the  Office  of  Academic  Affairs. 

3.  Effecting  Changes  to  Position  Schedules. 

a.  Within  10  days  of  receipt  of  the  USASA  Position  Deployment 
Schedules  (received  from  HQ,  USASA  3 to  6 months  prior  to  each  nev  fis- 
cal year),  the  Director  of  Logistics  will  forward  copies  of  the  Position 
Deployment  Schedules  to  the  Director  of  Instruction  and  department 
directors. 

b.  Within  10  days  of  receipt  of  the  new  Position  Deployment 
Schedules  or  changes  thereto,  the  Director  of  Logistics  will  forward 
programmed  requirements  spread  sheets  to  the  divisions  concerned. 

c.  Within  10  days  of  receipt  of  the  requirements  spread  sheet 
the  Division  Chief  will: 

(1)  Submit  requests  for  new  equipment  required  during 
the  present  fiscal  year,  within  the  limits  of  funds  available.  If 
funds  are  not  available,  unfinanced  requirements  will  be  reported  to 
the  Comptroller,  through  the  Director  of  Logistics. 

(2)  Report  equipment  rendered  excess  as  a result  of 
reduction  in  programmed  requirements,  in  accordance  with  section  B of 
this  chapter. 

d.  The  Director  of  Logistics  will  take  action  to  obtain  auth- 
orisation for  additional  equipment  required  due  to  increases  in  the 
position  schedules. 

e.  Department  Directors  will  review  their  areas  of  responsi- 
bility to  insuva  that  the  current  Position  Deployment  Schedule  is  ade- 
quate to  accomplish  their  assigned  instructional  mission. 

f.  Budget  planning  for  new  fiscal  years  must  Include  funds 
for  new  equipment  required  by  the  Position  Deployment  Schedules  for 
that  period.  Bills  of  materials  of  equipment  and  components  contained 
in  the  positions  and  facilities  are  published  by  HQ,  USASA.  Copies 
are  obtainable  from  the  Director  of  Logistics. 
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SAMPLE  ANALYSIS 


Sequential  Liatlna  of  Equipment  laouirame nt»  Per  CUm 


LP/litt  Mo. 

Tima 

Allocation 

lot true t loot 1 
StrattitY 

Requirement a 

1 

2 

3 

4 

KA  0001 

35 

L 

One  10 -nan  claaaroom. 

EA  0103 

7 

LD 

One  10-nan  classroom 
and  1 ta  AH/G3Q-88, 
AK/GSQ-77,  and 

AN/HSC-99. 

EQ  0104 

28 

PE 

One  rooo  adequate  to 
lnttall  3 ea  AN/CSQ-88, 

3 ea  AH/GSQ-77,  and 

2 ea  AH/NSC-99.  (See 
note  1.) 

EA  0109 

7 

GPE 

Uaes  EA  0104  equipment. 

EA  0111 

14 

LD 

One  10-man  clattrooa  and 

1 mockup  ea  of  control 
panele  for  tactical  poei~ 
done  ABC-13,  DEFG4 , end 
MKR-37, 

EA  0113 

14 

LD 

One  10-man  classroom  and 

1 ea  AT- 904,  AT-903,  and 

5kw  Gen. 

KA  0123 

70 

FT 

Required  fid  tng  on  2 ea 
ABC-13,  2 ea  DKFG-4,  end 
i ea  MKR-37.  (See  note  2.) 

EA  0125 

14 

PE 

Demo  equipment  uaed  In 
phaaea  2 and  5 respec- 
tively on  each  morning 
of  phase  8A. 

CT  5000 

7 

Teet 

One  10-man  claaeroom. 

EA  0126 

3 

Ft 

One  ea  ABC- 13,  DEFG-4,  and 

HKR-37  claaaroom. 
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Annex  A (cont) 


»ote  1:  In  LP  EA  0104,  the  AM/GSQ-88  It  required  for  50  per 
cent  of  the  Instruction;  the  AN/GSQ-77  ie  needed  for 
33  per  cent  of  the  Instruction;  i.ttd  the  AH/KSC-99  is 
required  for  17  per  cent  of  the  Instruction,  These 
figures  ere  estimates  of  the  tine  needed  to  complete 
eech  PE.  If  this  equipment  were  taught  In  separate 
phases,  the  requirement  would  increase  to  5 each. 

The  determination  of  whether  groups  of  equipment  may 
be  taught  together  depends  on  whether  a particular 
sequence  of  Instruction  for  the  items  applies. 

Hate  2:  The  three  mobile  positions  used  in  the  Field  Problem 
are  used  in  conjunction  with  each  other.  TVo  men 
operate  each  position;  therefore,  five  positions  are 
required.  During  the  70-hour  PE  the  students  will 
operate  all  of  the  positions  by  rotation. 
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Annex  C 

tat  at.  nnriTPMENY  REQUIREMENTS  FOR  INSTRUCTION  OF 

’ 1 l^S  000 

ASSUMING  THE  STATEMENTS  I*  ANNEX  B TO  BE  C.qaRgCT 


Line  Item  Number 


0**001 


Q**002 

Q**003 

0**004 

0**005 

0**006 


Equipment 
10 -man  classroom 
10 -man  equip  lab 
AN/GSQ-88 
AN/GSQ-77 
AN/MSC-99 
AT  904,  antenna 
AT  903,  antenna 
1.5  kw  gen 
Mock  control  panels 
ABC-13 
DEFG-4 
MKR-37 

Complete  mobile  positions 
ABC-13 
DEFG-4 
MMR-37 
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CHAPTER  10 


DETERMINING  INSTRUCTOR  REQUIREMENTS 
A.  INTRODUCTION 

1.  General.  At  this  point  in  the  development  of  an  instruc- 
tional system,  the  training  objectives  have  been  translated  into  per- 
formance terms,  a criterion  measure  has  been  prepared,  course  content 
has  been  selected,  a tentative  course  sequence  has  been  developed, 
tentative  time  allocations  have  been  set  for  each  instructional  block, 
and  an  instructional  strategy  has  been  chosen.  All  of  the  foregoing 
steps  provide  data  which  must  be  carefully  weighed  in  determining  the 
number,  kind,  and  skills  of  Instructors  required  to  conduct  the  course. 

2.  Phases  in  the  Development  of  Standards.  If  instruction  it 
to  be  conducted  with  optimum  effectiveness,  efficiency,  and  economy, 
scientific  standards  based  on  data  derived  from  experimental  studies 
must  be  applied  in  determining  instructor  requirements.  However, 
scientific  standards  cannot  be  established  overnight.  A start  must  be 
made  somewhere.  For  this  reason,  instructor  standards  are  developed  in 
three  phases: 

a.  Judgmental  Phase.  The  initial  determination  of  instructor 
requirements  is  established  largely  by  the  application  of  Judgment,  and 
supplemented  by  local  experience  and  review  of  standards  used  in  similar 
training  situations. 

b.  Experimental  Phase.  Once  judgmental  standards  have  been 
established  and  put  into  effect  in  a course  of  instruction,  experimental 
standards,  based  on  observation  and  experience  with  the  standards,  are 
applied.  That  is,  the  judgmental  standards  are  modified  as  a result  of 
local  experience  with  the  standards. 

c.  Scientific  Phase.  Lastly,  experimental  standards  are  sub- 
jected to  rigorous  and  carefully  controlled  tryout.  Analysis  of  the 
data  resulting  from  controlled  experimentation  produces  scientific 
standards  for  use  in  determining  instructor  requirements. 

B.  INSTRUCTOR  SKILLS 

1.  Bases  for  Selection.  Ihe  content  of  a specific  block  of  instruc- 
tion and  the  instructional  strategy  chosen  dictate  the  type  of  instructor 
required  to  handle  the  block.  Although  all  instructors  have  been  exposed 
to  inatructor  training,  their  previous  technical  experience,  their  plat- 
form experience  in  terms  of  amount  and  kind,  their  instructional  skills, 
and  their  preferences  for  certain  methods  of  instruction  vary  consider- 
ably. The  objective  In  assigning  instructor  responsibility  in  a speci- 
fic content  area  is  to  select  the  beat  qualified  man  in  terms  of  possess- 
ing both  the  technical  competency  and  the  instructional  akills  required 
to  use  the  optimum  strategy. 
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2.  Instructor  Capabilities.  Different  instructional  strategies 
make  varying  demands  on  the  instructor.  Regardless  of  which  strategy 
is  used,  the  basic  requirement  is  knowledge  of  the  subject  matter.  An 
instructor  cannot  teach  what  he  does  not  know.  In  addition  to  this  pri- 
mary consideration,  there  are  instructor  skills  and  abilities  which  are 
critical  to  the  successful  application  of  any  strategy.  These  critical 
skills  and  abilities  and  related  strategies  are  identified  below: 

a.  Lecture  Method.  The  instructor  must  be  able  to: 

(1)  Organize  subject  matter  for  effective  oral  presenta- 
tion. 

(2)  Speak  clearly,  forcefully,  and  effectively. 

(3)  Stimulate  interest  and  enthusiasm,  and  "sell"  the 
importance  of  his  subject. 

(4)  Vary  his  presentation,  in  terms  of  vocabulary, 
sentence  structure,  and  illustrations,  to  fit  his  audience. 

(5)  Select  wisely  and  use  skillfully  a variety  of  train- 
ing aids. 

(6)  Check  the  adequacy  of  his  presentation  through  the 
effective  use  of  on-the-spot  techniques;  e.g.,  questioning. 

b.  Conference  Method.  The  instructor  muBt  be  able  to: 

(1)  Speak  clearly,  effectively,  and  informally. 

(2)  Stimulate  student  interest  and  participation. 

(3)  Maintain  an  informal  atmosphere. 

(4)  Provide  the  guidance  required  to  keep  the  group  con- 
tinuously aware  of  desired  teaching  points  and  instructional  objectives. 

(5)  Keep  the  group  aware  of  how  well  it  is  meeting  its 

goals. 

(6)  Summarize  discussion  points  quickly  and  clearly. 

c.  Demonstration  Method.  The  instructor  must  be  able  to: 

(1)  Organize  his  deoorstration  to  effect  the  most  effi- 
cient learning. 

(2)  Use  tools,  equipment,  and  aids  skillfully. 

(3)  Speak  clearly,  forcefully,  and  effectively. 

(4)  Adjust  his  commentary  to  the  group. 

(5)  Diagnose  group  difficulties  and  provide  immediate 
remedial  measures. 

d.  Performance  Method.  In  addition  to  the  skills  defined  in 
paragraph  c,  above,  the  instructor  must  be  able  to: 

(1)  Diagnose  individual  student  learning  difficulties. 

(2)  Function  effectively  as  a tutor. 

e.  Programmed  Instruction.  The  instructor  must  be  able  to: 

(1)  Diagnose  individual  student  learning  difficulties. 

(2)  Conduct  tutorial -type  remedial  instruction. 

(3)  Motivate,  counsel,  and  guide  each  student. 

(4)  Determine  the  appropriate  pace  to  be  maintained  by 

each  student. 

f . Other  Strategies. 

(1)  To  function  effectively  as  an  instructor  using  a com- 
bination of  methods,  or  in  team  learning,  the  instructor  oust  be  able 
Co  perform  all  of  the  functions  defined  in  subparagraphs  a.  through  e. 
above . 
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(2)  For  team  teaching,  the  skills  required  will  vary 
with  the  position  the  instructor  occupies  on  the  team,  the  grouping 
arrangement,  and  the  strategy  involved.  The  team  leader  must  be  able 
to  perform  all  of  the  functions  identified  in  paragraphs  a.  through  e. 
above.  A team  member,  however,  is  not  required  to  have  the  full  range 
of  instructional  skills. 


C . STANDARDS 

1.  Preliminary  Considerations.  In  addition  to  data  pertaining 
to  the  course  of  instruction  referred  to  in  section  A,  para  1 above, 
the  determination  of  instructor  requirements  must  be  based  upon  equi- 
table instructor  workloads,  reasonable  student-instructor  ratios,  and 
realistic  plat form-to -preparation  time  ratios. 

2,  Interim  Standards.  Until  such  time  as  experimental  and  sci- 
entific standards  can  be  developed,  the  standards  described  below  and 
as  specified  in  annex  A will  be  applied. 

a.  Maximum  Number  of  Platform  Hours.  A reasonable  workload 
is  essential  to  effective  instruction.  Although  it  may  be  possible  to 
schedule  an  instructor  for  eight  consecutive  hours  of  instruction,  the 
quality  of  his  instruction  is  likely  to  deteriorate  considerably  as  the 
day  progresses.  In  addition,  to  be  effective,  instructors  must  be  well 
prepared  and  rehearsed.  Time  must  be  allotted  for  preparation  and 
rohearsel.  For  these  reasons,  instructor  workload  during  a specific  day 
and  during  a specific  week  must  be  limited.  Since  certain  types  of 
instruction  are  more  demanding  in  terms  of  both  lesson  preparation  and 
the  conduct  of  the  lesson,  different  maximums  must  be  set  for  each 
Instructional  strategy.  Interim  standards,  in  terms  of  maximums,  are 
defined  in  columns  2 and  3,  annex  A. 

b.  Ratios  of  Platform-to-Preparation  Time.  Different 
instructional  strategies  require  varying  amounts  of  preparation  time. 

It  should  also  be  evident  that  the  original  preparation  for  an  instruc- 
tional unit  requires  considerably  more  time  than  preparation  for  subse- 
quent repetitions  of  the  same  lesson.  The  complexity  of  content,  the 
availability  of  reference  materials,  and  the  amount  of  research  required 
are  variables  which  ©ay  necessitate  a great  deal  more  preparation  time. 
For  this  reason,  the  interim  standards  for  the  platform-to-preparation 
time  ratios,  defined  in  columns  4 and  5,  annex  A,  are  stated  as 
tsinirauas  for  initial  preparation  and  as  maximums  for  succeeding  or 
repeated  presentations  given  by  the  same  instructor, 

c.  Ins true tor -to -Student  Ratios.  The  number  of  students  that 
can  be  handled  adequately  by  one  instructor  is  mainly  a function  of  the 
strategy  employed.  At  times,  however,  the  content,  particularly  that 
which  deals  primarily  with  the  development  of  manipulative  skills,  dic- 
tages  larger  instructor-to-student  ratios.  For  this  reason,  the  interim 
standards  for  ins true tor -student  ratios,  defined  in  column  7,  annex  A, 
are  maximums.  In  short,  limitations  of  content,  room  size,  equipment, 
and  the  like  may  require  smaller  numbers  of  students  per  instructor  than 
the  indicated  ratios. 
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D.  PROCEDURES 


1.  Determining  the  Humber  of  Instructors  Required. 

a.  Introduction.  The  number  of  instructors  required  to  con- 
duct a course  of  instruction  is  the  product  of: 

(1)  The  number  of  program  of  instruction  (POI)  hours  of 
each  "type"  instruction. 

(2)  The  "instructor  factor"  for  each  "type"  instruction. 

(3)  The  "platform/preparation  factor." 

(4)  The  number  of  classes  taught  per  year. 

(5)  An  additional  allowance  of  10  percent  for  super- 
vision, 11  percent  leave  and  sick,  and  4 percent  commander's  time. 

The  procedures  for  performing  these  calculations  are  defined  in 
ASATC&S  Reg  Ho.  616-2.  All  calculations  are  entered  on  IAT  Form  178 
(annex  C). 

b.  Instructor  Factor.  This  factor  represents  the  average 
number  of  instructor  man-hours  required  to  teach  each  scheduled  academic 
POI  hour,  in  each  method  of  instruction.  The  actual  POI  teaching  hours 
are  separated  according  to  the  instructional  methods  as  specified  in 
the  course  POI.  A determination  of  the  average  number  of  instructor 
man-hours  required  for  each  scheduled  POI  hour  in  each  method  of 
instruction  is  made  (annex  B).  The  following  items  must  be  considered 
for  each  instructional  method  when  determining  the  instructor  factor: 

(1)  The  number  of  students  in  a class. 

(2)  The  number  of  student  positions  available  in  the 
classroom  or  training  area  (including  both  seating  and  equipment  posi- 
tions). 

(3)  The  physical  layout  of  the  training  area. 

(4)  Safety  requirements. 

(5)  Course  content,  particularly  that  which  deals  pri- 
marily with  development  of  manipulative  skills. 

(6)  Any  other  special  or  limiting  factors. 

c.  Platform  Preparation  Factor . This  factor  represents  a 
relationship  between  the  number  of  hours  an  instructor  can  teach  a 
specific  course  of  instruction  per  day  and  the  total  number  of  teaching 
hours  available  per  day.  If  it  is  determined  that  due  to  the  complexity 
of  the  instructional  material  an  instructor  can  teach  only  two  hours  per 
day  and  there  are  eight  hours  available  in  the  school  day,  the  platform 
factor  is  8 divided  by  2,  or  4.0.  The  following  items  must  be  consid- 
ered in  determining  the  platf ora/preparation  factor: 

(1)  Complexity  of  the  material  to  be  presented. 

(2)  The  availability  of  materials. 

(3)  The  amount  of  research  required. 

2.  Determining  the  Types  of  Instructor a Required.  The  instruc- 
tional skills  required  to  conduct  a specific  instructional  block  are 
implicit  in  the  content  to  be  presented  and  in  the  strategy  selected  to 
teach  it.  The  steps  in  determining  the  type  of  instructor  required  are 
as  follows: 
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a.  Check  the  POI^  to  determine  what  the  recommended  primary 
lnatructional  strategy  is. 

b.  From  the  FOI,  note  the  technical  content  to  be  presented. 

c.  compare  steps  a.  and  b.  against  the  current  list  of  assigned 
instructors,  considering  their  technical  knowledge  and  experience,  and 
their  instructional  competencies. 

d.  Select  the  best  qualified  instructor  and  assign  him  the 
responsibility  for  the  block  of  instruction.  Select  the  second  best 
qualified  instructor  as  his  alternate. 

e.  If  the  desired  combination  of  technical  background  and 
instructional  competence  cannot  be  obtained; 

(1)  Go  through  steps  l.b.  through  d.  with  the  alternative 
strategy  noted  in  the  POI. 

(2)  Submit  a request  for  the  assignment  of  an  instructor 
who  possesses  the  required  qualifications  when  the  missing  element  is 
technical  competence. 

(3)  Arrange  to  have  the  best  qualified  Instructor  receive 
special  training  from  Instructional  Methods  Division  if  the  missing  skill 
is  instructional. 

3.  Determining  Instructor  Grade  Authorisations.  The  grade  structure 
for  enlisted  instructors  can  be  ascertained  from  section  VII,  AR  611-201. 


*See  Chapter  12 


10-5 


chapter  11 


SETTING  COURSE  PREREQUISITES 
A.  INTRODUCTION 


1.  Definition.  Prerequisites  are  the  minimum  qualifications  which 
a man  must  have  prior  to  enrollment  in  a course  of  instruction.  Pre- 
requisites represent  a prediction  of  the  aptitudes,  knowledge,  skills, 
and  experience  required  for  successful  course  completion.  Prerequisites 
may  be  general  or  special.  General  prerequisites  are  applicable  to  all 
courses  of  instruction  and  are  required  of  all  enrollees  in  addition  to 
the  general  prerequisites. 

2.  Authority.  The  Comnanding  General,  USASA  is  responsible  for 
setting  course  prerequisites  for  ASA  military  occupational  specialties. 
These  prerequisites  are  established  in  accordance  with  DA,  NSA,  and 
USCONARC  standards,  and  are  promulgated  in  Army  regulations  and  DA  Pam- 
phlet 350-10  by  The  Adjutant  General  who  insures  compliance  with  mini- 
mum Army  standards. 

3.  Uses  of  Prerequisites. 

a.  Administrative.  The  primary  reason  for  establishing  pre- 
requisites is  to  insure  that  the  right  man  are  selected  for  a training 
program.  That  is,  prerequisites  are  set  so  as  to  increase  the  chances 
of  satisfactory  course  completion  by  personnel  selected  for  training. 
Therefore,  prerequisites  are  used  to  establish  and  apply  screening  and 
selection  instruments  and  procedures  for  assigning  personnel  to  training 
programs.  Specifically,  prerequisites  are  used  in  the  screening  and 
selection  process  as  follows: 

(1)  Selecting/developing  aptitude  tests.  The  selection 
or  development  of  appropriate  aptitude  tests  is  reliant  on  the  accurate 
identification  and  precise  definition  of  those  aptitudes  which  are 
required  for  successful  completion  of  the  course.  For  example,  if  digi- 
tal dexterity  is  identified  as  a prerequisite  for  training  as  an  elec- 
tronics equipment  repairman,  those  responsible  for  screening  and  assign- 
ing personnel  to  repair  courses  must  select  (or  devise)  and  administer 

a teat  of  digital  dexterity. 

(2)  Screening  applications/records.  A list  of  prerequi- 
sites is  essential  in  the  conduct  of  the  preliminary  screening  of  appli- 
cations for  course  enrollment  snd  for  the  screening  of  records  to  deter- 
mine personnel  to  be  assigned  to  a course  of  instruction.  Unsuitable 
personnel  can  be  easily  and  quickly  eliminated  from  consideration  if  a 
we 11 -conceived  list  of  prerequisites  ia  available. 
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(3)  Interviewing  applicants/nominess . If  the  personal 
interview  is  used  as  a part  of  the  screening  and  selection  process,  a 
list  of  prerequisites  can  serve  as  the  starting  point  in  collecting  data 
about  course  applicants  or  nominees.  Such  a listing  will  insure  that 
the  information  required  for  objective  evaluation  is  obtained  and  that 
areas  of  particular  interest  are  fully  explored  by  the  interviewer. 

b.  Instructional.  Prerequisites  can  also  serve  instructional 
purposes.  Two  of  the  more  important  uses  of  prerequisites  in  instruc- 
tion are  as  follows; 

(1)  Lesson  planning.  Instructors  can  advantageously  use 
prerequisite  lists  in  planning  their  work  and  in  developing  instruc- 
tional materials.  The  aptitudes,  abilities,  and  experience  of  the  stu- 
dent input  have  a direct  bearing  on  the  selection  of  appropriate  instruc- 
tional strategies  and  the  development  of  instructional  materials.  To 
plan  adequately,  the  instructor  must  have  accurate  information  about 

the  characteristics  of  the  typical  student.  He  needs  to  know  what  the 
student  brings  to  the  training  program.  A well-written  list  of  pre- 
requisites meets  this  need. 

(2)  Constructing  tests.  Student  aptitudes  and  abilities 
must  be  considered  in  selecting  or  developing  evaluative  instruments 
and  techniques.  A knowledge  of  the  prerequisites  of  a course  is  essen- 
tial to  the  construction  of  appropriate  achievement  tests,  particularly 
as  they  relate  to  the  type  of  test,  the  instructions  to  the  student, 
the  complexity  of  sentence  structure,  and  the  vocabulary  level, 

4.  Importance  of  Prerequisites. 

a.  Prevent  Waste  of  Training  Resources.  Some  years  ago, 
aptitudes  were  considered  to  be  special  talents  which  were  due  exclu- 
sively to  innate  or  hereditary  differences  among  people.  Today,  apti- 
tude is  more  accurately  defined  as  a mixture  of  inborn  potential  and 
acquired  abilities.  Regardless  of  how  aptitude  is  defined,  it  is  impor- 
tant to  remember  that  different  types  of  work,  and  the  training  for  that 
work,  require  different  combinations  of  ability  and  experience.  Train- 
ing resources  will  be  wasted  if  the  personnel  selected  to  receive  train- 
ing do  not  have  the  required  aptitudes.  To  be  effective  and  efficient, 
training  must  be  provided  only  to  students  who  have  been  carefully 
acreened  and  selected  for  suitability.  However,  before  screening  and 
selection  procedures  can  be  applied,  the  selection  requirements  and 

the  prerequisites  of  the  training  program  must  be  identified  and 
described  with  precision.  Successful  establishment  of  realistic  and 
adequate  prerequisites  prevents  the  waste  of  time  and  other  training 
resources  by  increasing  the  chances  that  enroilees  in  a particular  course 
will  complete  it  satisfactorily. 

b.  Insure  an  Acceptable  Level  of  Performance  in  the  Field. 
Establishing  prerequisites  which  make  certain  that  students  assigned  to 
a course  have  the  aptitudes,  abilities,  and  experience  to  complete  the 
course  successfully  and  at  acceptable  time  and  resource  cost  levels  is 
only  one  aspect  of  the  problem.  Prerequisites  must  also  insure  that 
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graduates  of  the  training  program  will  be  able  to  perform  their  assigned 
duties  at  an  acceptable  level  of  proficiency  when  they  arrive  at  field 
units.  If  prerequisites  are  set  too  high,  the  number  of  individuals 
available  for  a given  course  of  instruction,  and  ultimately  for  assign- 
ment to  a given  job,  is  sharply  reduced.  On  the  other  hand,  if  prerequi- 
sites are  set  too  low,  a heavier  investment  in  training  must  be  made  to 
bring  the  trainees  up  to  an  acceptable  level;  but,  if  the  additional 
investment  of  training  resources  is  not  made,  the  consequence  will  be 
reduced  levels  of  initial  job  performance,  increased  on-the-job  training 
requirements,  and  a decrease  in  unit  efficiency  in  performing  its  mis- 
sion. It  is  also  likely  that  the  attrition  rates  will  increase.  The 
solution  to  the  problem  lies  in  establishing  prerequisites  at  the  right 
level;  i.e.,  neither  too  high  nor  too  low. 


B.  ELEMENTS  OF  PREREQUISITES 


There  are  basically  five  elements  to  be  considered  in  setting  the 
prerequisites  for  any  course  of  instruction.  These  elements  are  desig- 
nated as  follows: 

1,  Administrative.  This  element  contains  itemB  which  insure  com- 
pliance with  Army  regulations  with  respect  to: 

a.  Length  of  obligated  service  (AR  600-200  and  350-100). 

b.  Status  requirement  (military  or  civilian;  active  or  reserve). 

c.  Pay  grade  (enlisted,  officer,  or  civilian). 

2-  Physical . This  element  includes  the  following  qualification 
areas  that  will  insure  proper  physical  capability  to  engage  in  the  activ- 
ities of  the  M0S  for  which  trained: 

a.  Physical  profile  serial  (AR  611-101  and  611-102). 

b.  Physical  skills  (AR  611-201  and  611-202). 

c.  Special  requirements  (e.g.,  color  perception  for  electronic 
maintenance  training). 

3.  Clearance,  This  element  Includes  special  ASA  requirements  per- 
taining to: 

a.  Security  clearance. 

b.  Briefing  for  special  intelligence. 

4.  Academic . This  element  may  include  any  of  the  following  appli- 
cable educational  or  aptitude  considerations: 

a.  Military  training  and  experience. 

b.  Civilian  training  and  experience. 

c.  Array  aptitude  area  scores  (AR  611-201). 

d.  Special  skills,  abilities,  or  knowledge. 

e.  ASA  or  NSA  aptitude  test  scores. 

f.  Civilian  aptitude  test  scores  (e.g.,  IBM  ADPS  Programmers' 
Aptitude  Test) 
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5.  Other . This  element  may  include  any  other  requirements. 

a.  Personality  traits. 

b . Temperament . 

c.  Special  factors  (e.g. , citizenship,  etc.). 


C.  PROCEDURES 


1.  Establishing  Prerequisites. 

a.  Chief,  Evaluation  Unit  will  identify,  list,  and  describe 
the  prerequisites  for  each  course  of  instruction  as  outlined  in  section 
B of  this  chapter.  In  developing  these  prerequisite  statements,  the 
following  sources  of  data  will  be  used: 

(1)  Mission  task  as  established  by  HQ,  USASA,  NSA,  and 
supported  commands. 

(2)  Pertinent  DA,  USCONARC,  and  HQ,  USASA  regulations  and 

directives. 

(3)  Conmand  Job  Analyses  Reports.  Particular  attention 
will  be  given  to  the  following  items: 

(a)  Summary  description  of  the  position,  which 
should  be  related  to  the  initial  job  requirement. 

(b)  Detail  of  duties  and  tasks,  which  should  be 
related  to  the  course  content. 

(c)  Knowledge  and  skill  requirements,  which  should 
be  related  to  course  content,  civilian  educational  level,  and  aptitude 
area  scores. 

(d)  Aptitude,  physical,  and  personal  requirements, 
which  should  be  related  to  standards  established  by  DA,  USCONARC,  and 
HQ,  USASA. 

(e)  General  comments,  which  should  contain  any  addi- 
tional pertinent  information. 

(4)  School  training  requirements  as  defined  in  the  train- 
ing objectives.  (See  chapter  2.) 

(5)  the  outline  of  course  content  developed  from  the 
Performance  Objective  Workcards.  (See  chapter  6.) 

(6)  Field  evaluation  reports,  to  include  the  comments  of 
coamanders,  supervisory  personnel,  and  Job  incumbents.  (See  chapter  15.) 

(7)  The  judgments  of  field  experienced  instructors  and 
supervisory  personnel.  (See  chapter  13.) 

b.  Initial  statements  of  prerequisites  will  be  submitted  by 
Chief,  Evaluation  Unit  to  the  following  for  review: 

(1)  Technical  Consultant. 

(2)  Educational  Consultant. 

(3)  Director,  Office  of  Personnel  and  Administration. 

(4)  Director  of  Instruction. 

c.  Upon  receipt  of  concurrences  of  personnel  listed  in  para- 
graph b above,  prerequisites  will  be  submitted  to  the  Assistant  Commandant 
for  review  and  approval  for  use  in  pilot  courses. 
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2. 


Evaluating  Prerequisites, 

a.  Pilot  Course  Evaluation. 

(1)  During  the  conduct  of  the  pilot  course/s,  Chief, 
Evaluation  Unit  will  gather  objective  data  for  later  use  in  revising 
prerequisites  as  required.  The  following  sources  will  be  used  to  col- 
lect data  for  evaluating  the  adequacy  of  prerequisites. 

(a)  Student  opinion  surveys. 

(b)  Student  interviews. 

(c)  Instructor  interviews. 

(d)  Instructor  surveys, 

(e)  Classroom/ laboratory  observation. 

(f)  Analysis  of  tests  and  quizzes. 

(2)  At  the  conclusion  of  each  pilot  course.  Chief, 

Evaluation  Unit  will  evaluate  prerequisites  by  the  following  means: 

(a)  Analysis  of  all  go/no-go  performance  teats  based 
on  statistical  analysis  provided  by  Chief,  Evaluation  and  MOS  Test  Divi- 
sion as  follows: 

Correlation  and  regression  analyses,  i.e,, 
the  relationship  between  prerequisites  (dependent  variable)  and  class- 
room performance  (independent  variable). 

2.  Statistical  techniques  will  also  be  applied 
to  the  performance  of  academic  failures  and  recycled  and  diverted  stu- 
dents. 

(b)  Student  surveys  and  interviews 

(c)  Instructor  surveys  and  interviews. 

b.  Field  Evaluation.  Systematic  evaluation  of  the  perform- 
ance of  graduates  of  pilot  courses  will  be  accomplished  by  Chief, 
Evaluation  Unit  as  a part  of  field  evaluation  followup  visits.  Speci- 
fically, the  following  checks  will  be  made: 

(1)  The  adequacy  of  current  prerequisites  in  providing  an 
adequate  supply  of  qualified  personnel  to  field  units. 

(2)  The  need  for  on-the-job  (OJT)  training;  i.e.,  are  OJT 
requirements  excessive  or  acceptable  to  commanders? 

(3)  The  relationship  between  performance  in  the  school 
and  performance  on  the  job , 

3.  Revising  Prerequisites. 

a.  Following  completion  of  the  actions  described  in  paragraph 
2 of  this  chapter  and  after  analysis  of  the  data,  Chief,  Evaluation  Unit 
will  draft  and  staff  a revised  set  of  prerequisites  as  follow*: 

(1)  Technical  Consultant. 

(2)  Educational  Consultant. 

(3)  Director,  Office  of  Personnel  and  Administration. 

(4)  Director  of  Instruction. 

(5)  Assistant  Commandant. 

b.  Upon  receipt  of  concurrences  in  the  revised  list  c.f  pre- 
requisites, Chief,  Evaluation  Unit  will  prepare  a letter  to  the  Commanding 
General,  USASA  recommending  a change  to  the  AR  Job  description.  The 
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letter  will  Include: 

(1)  Identification  of  the  weaknesses  of  existing  prerequi- 
sites  based  on  the  findings  of  in-school  and  field  evaluation.  These 
weaknesses  may  Indicate  that  the  prerequisites  are  set  either  too  low  or 
too  high. 

(2)  Identification  of  proposed  prerequisites  that  will 
correct  the  deficiencies  noted. 


D.  REFERENCES 


1.  AR  611-101. 

2.  AR  611-102. 

3.  AR  611-201. 

4.  AR  611-202. 

5.  AR  600-200. 

6.  AR  350-100. 

7.  DA  Pass  350-10. 

8.  DA,  Army  Job  Analysis  Manual  I,  March  1960. 

9.  tetter,  IAT0P-T,  KQ,  US  Army  Security  Agency,  13  February  1960, 
subject:  Programs  of  Instruction  and  Lesson  Plans. 

10 • OSASA  CoiasSnd  Job  Analysis  System.  Job  Analysis  Handbook  and 
Guide,  Edition  II,  Evaluation  Unit,  USASATC(iS,  Fort  Devena,  Naas.,  1966. 
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CHAPTER  12 


DEVELOPING  INSTRUCTIONAL  MATERIALS 

A.  REVIEW  OF  STEPS 


At  this  point  in  the  development  of  an  instructional  system,  both 
the  input  to  the  training  program  and  the  required  output  have  been 
described  in  detail.  The  input  has  been  identified  in  terms  of  pre- 
requisites for  enrollment  in  the  training  program,  and  the  required 
output  has  been  described  in  terms  of  performance  objectives.  In  addi- 
tion, the  means  of  producing  the  desired  product  have  been  specified. 
That  is,  the  instructional  strategy,  together  with  its  supporting  train- 
ing aids,  has  been  selected;  equipment  and  instructor  requirements,  in 
terms  of  kinds  and  number,  have  been  determined;  and  criterion  measures 
both  internal  and  end-of -course,  have  been  prepared.  The  next  step  is 
to  produce  the  documents  which  collate  these  data  into  readily  usable 
form  and  to  set  time  allocations  for  each  instructional  unit. 


B.  PROCEDURES 


1.  Preparation  of  Lesson  Plans. 

a.  General. 

(1)  In  addition  to  the  information  contained  in  this  sec- 
tion, the  guide  for  the  preparation  of  lesson  plans  (LP)  and  the  sample 
LP  commencing  on  page  12-15  will  be  used  in  preparing  IP.  Additional 
guidance  may  be  found  in  the  USASATC&S  Style  Manual,  ST  32-4000. 

(2)  Performance  objective  workcards  furnished  by  the 
Evaluation  Unit  and  their  supporting  content  outlines  developed  by  the 
responsible  academic  elements  provide  the  basic  sources  of  guidance  for 
determining  LP  content. 

(3)  In  preparing  LP,  coordination  within  each  department 
and  with  other  departments  will  be  effected  to  insure  that  there  is  no 
unnecessary  duplication  or  conflict  in  the  content  to  be  presented. 

(4)  At  least  four  copieg  of  each  LP  will  be  prepared  to 
insure  the  distribution  listed  in  paragraph  d below. 

(5)  Classified  LP  will  comply  with  the  provisions  of 
current  security  regulations. 

(6)  Academic  departments  will  maintain  a file  of  all  LP 
currently  in  use  in  their  departments  (except  LP  containing  crypto- 
material). 

b.  Preparation  of  Draft  Copies. 

(1)  LP  will  be  prepared  by  the  academic  department  in 
accordance  with  the  provisions  of  this  chapter,  to  include  the  sample 
LP  provided,  (annex  B,  pages  12-15  through  12-13),  and  references  cited 
in  section  C of  this  chapter. 
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(2)  Academic  department*  will  incorporate  the  latest  doc- 
trine in  each  LP.  Where  doctrine  has  not  been  clearly  defined  in  offi- 
cial publications,  academic  departments  will  consult  with  the  Director, 
Office  of  Training  Literature  to  establish  the  "school  position." 

(3)  LP  as  prepared  internally  will  be  submitted  in  draft 
form  to  the  department  director  for  review. 

(4)  Each  LP  will  be  thoroughly  reviewed  by  the  responsi- 
ble department  director  for  format,  organization,  strategy,  training 
aids,  accuracy  of  content  and  references.  Necessary  changes  will  be 
made  prior  to  forwarding  the  LP  to  the  Office  of  Training  Literature 
for  review  and  editing. 

(5)  Director,  Office  of  Training  Literature,  will 

insure  that  each  LP  is  doctrinally  accurate  and  editorially  correct,  and 
return  the  document  to  the  appropriate  academic  department. 

c.  Preparation  of  Final  Copies.  Upon  receipt  of  an  edited 
draft  copy,  department  directors  will  be  responsible  to: 

(1)  Prepare  the  LP  in  sufficient  copies  to  permit  the 
distribution  indicated  below.  A copy  of  the  final  LP  will  be  furnished 
to  the  Director,  Office  of  Training  Literature  for  proofreading  prior  to 
publicatio'i/distribution. 

(2)  Type  on  multilith  masters  LP  requiring  reproduction 
and  forward  the  masters  to  the  Director,  Office  of  Training  Literature 
for  proofreading  prior  to  publication.  Multilith  masters  containing 
errors  will  be  returned  to  the  appropriate  academic  departments  for  cor- 
rection. After  correction  of  errors  by  the  originating  academic  depart- 
ment, the  masters  will  be  routed  through  Director,  Office  of  Training 
Literature  to  Chief,  Reproductions  Section  for  publication. 

d.  Distribution. 

(1)  A minimum  of  one  original  and  three  copies  of  each 
approved  LP  will  be  prepared.  Distribution  will  be  as  follows: 

(a)  Original  to  Director,  Office  of  Training  Litera- 
ture (Director,  Department  3 for  cryptomaterial)  for  the  command  record 
copy  file. 

(b)  One  copy  for  the  instructor's  file. 

(c)  One  copy  for  the  monitor’s  desk  file. 

(d)  One  copy  for  the  department's  file. 

(2)  Additional  copies  may  be  prepared  in  such  numbers  aa 
the  department  director  deems  necessary. 

2.  Time  Allocations.  Realistic  estimates  of  the  amount  of 
instruction  time  a student  requires  to  develop  necessary  Job  performance 
standards  cannot  be  made  until  a lesson  plan  ha6  been  drafted.  Since 
no  experience  factor  is  available  for  performance-oriented  instruction, 
initial  time  allocations  must  be  calculated  mathematically.  To  do  these 
calculations  properly  several  factors  oust  be  considered,  both  individu- 
ally and  in  combination. 

a.  Factors  to  Consider  in  Estimating  Time  Requirements. 

(1)  The  type  of  content  involved.  The  nature  of  the  con- 
tent (whether  a series  of  facts  and  principles  or  a skill)  has  a aireet 
relationship  to  time  requirements. 
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(2)  The  amount  of  detail.  Tho  number  of  separate  facts 
or  principles,  or  the  number  of  separate  elements  within  a skill, 
relates  to  time  requirements, 

(3)  The  learning  difficulty.  Difficulty  in  the  learning 
of  a sped  tic  principle,  concept,  or  skill  has  a direct  bearing  on  the 
titan  required  to  teach  it. 

(A)  The  instructional  strategy.  The  method  or  medium 
(lecture,  programmed  instruction,  performance)  used  to  toach  the  prin- 
ciple, concept,  or  skill  relates  to  time. 

(5)  The  testing  strategy.  Time  requirements  will  vary 
with  the  type  of  evaluation  strategy  used.  For  example,  individual 
testing  requires  more  time  than  group  testing;  performance  tests 
usually  require  more  time  than  paper-  and-  pencil  instruments. 

(6)  Number  of  students.  The  factor  of  class  sire  is 

of  primary  importance  when  coupled  with  other  factors;  e.g.,  strategy, 
equipment,  and  instructors. 

(7)  Number  of  instructors.  The  availability  or  non- 
availability of  assistant  instructors  has  a direct  relationship  to 
t:  ime . 

(8)  Number  of  equip, ..out  positions.  The  nonavailability 
of  equipment  positions  in  sufficient  numbers  to  commodate  the  number 
of  students  in  a class  will  materially  increase  to*-  amount  of  time 
required, 

(9)  Movement  of  students.  If  students  must  be  moved  or 
transported  to  a training  area  away  from  the  central  school  facilities, 
time  requirements  will  be  Increased. 

h.  Estimating  Time  Requirements.  Experienced  instructors  will 
be  asked  to  provide  three  estimates  of  the  amount  of  time  required  for 
the  students  to  learn  the  content  detailed  in  the  plan.  Estimates  will 
he  based  upon  consideration  of  the  factors  defined  in  paragraph  a above. 
The  three  estimates  are  as  follows: 

(1)  The  longest  time  it  would  take  if  tho  students  are 
slow,  the  class  Is  scheduled  late  in  the  day,  the  equipment  breaks  down, 
etc . 

(2)  The  most  likely  time  for  the  development  of  the  con- 
cept or  skill,  considering  that  all  conditions  are  routine. 

(3)  The  shortest  time  it  could  take  considering  that  all 
conditions  arc  optimum,  all  students  are  fast  learners,  all  equipment 
is  ready  and  operating,  etc. 

c.  Calculating  Time  Requirements,  The  throe  estimates  are 
averaged  within  themselves.  That  is,  an  average  is  obtained  for  each 
estimate  of  the  longest  (Eh),  most  likely  (EML) , and  shortest  (ES)  time 
estimates  us  shown. 


and , 


KLj  + El, 2 + EL3  Avg  EL 
3 

ESj  9-  ES2  + ES3  " Avg  KS 
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The  final  time  estimate  is  calculated  as  follows: 

TE  = Avg  EL  + 4 Avg  EML  + Avg  ES 

(Time  Estimate)  6 

d.  Refining  Time  Estimates.  The  time  estimates  computed  at 
this  point  are  gross  as  compared  to  net,  but  for  planning  purposes  they 
are  useful.  For  the  first  course  taught  under  the  new  system,  these 
time  estimates  will  be  entered  on  the  LP  and  used.  The  time  allocations 
will  be  revised  for  subsequent  classes  where  actual  experience  with  stu- 
dents indicates  a need  for  change. 

3.  Review  of  LP.  To  insure  that  all  material  covered  in  lesson 
plans  used  within  this  command  is  current,  the  following  procedures 
will  be  adhered  to  by  all  concerned. 

a.  Instructors  will  at  all  times  insure  that  their  respective 
plans  are  maintained  on  a current  basis.  Continual  review  of  material 
presented  is  a requirement.  Recommended  changes  will  be  coordinated  with 
Chief,  Evaluation  Unit  prior  to  publication. 

b.  Directors,  Academic  Departments  will  insure  that  all  LP 
within  their  respective  activities  are  reviewed  annually  as  follows: 

(1)  Review  will  be  accomplished  annually  during  the  month 
that  the  plan  was  originally  published.  Review  can  also  be  initiated  by 
the  Office  of  Training  Literature  or  the  Evaluation  Unit,  based  on 
receipt  of  additional  or  revised  information.  In  such  an  event,  timely 
notification  will  be  provided  to  academic  elements  concerned  in  order  to 
permit  accurate  revision. 

(2)  Date  of  review,  grade,  name,  and  title  of  person 
making  ths  review,  and  initials  of  the  individual  signing  the  review, 
will  be  shown  on  the  cover  sheet  portion  of  each  LP. 

(3)  Custodian  of  the  command  master  LP  file  will  be  noti- 
fied by  disposition  form  (DD  Form  96)  of  the  annual  review.  Disposition 
form  will  include  the  date  of  review,  grade,  name,  and  title  of  person 
making  the  review. 

c Custodian  of  the  coianand  master  LP  file  will,  upon  receipt 
of  notification  that  such  a review  has  been  completed,  take  the  action 
indicated  in  paragraph  3b(2)  above  as  it  pertains  to  the  master  LP  file 
copy. 


4 . Preparation  oi  PCI . 
a.  General . 

(1)  Programs  of  instruction  (POI)  will  be  pvepared  in 
accordance  with  the  information  contained  in  this  section  and  in  Annex 
C,  Guide  to  Preparation  of  POI.  Academic  departments  will  prepare  POI 
and  their  supporting  lesson  plans  (LP)  in  accordance  with  instructions 
contained  herein,  insuring  that  all  such  documents  are  current,  reviewed 
annually,  and  distributed  as  outlined  in  this  chapter.  A POI  will  be 
self-contained  in  that  actual  Job  requirements,  developed  from  Job  anal- 
ysis data,  can  bo  directly  correlated  with  the  performance  objectives 
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contained  within  Individual  leason  plana.  Academic  departmenta  will 
also  prepare  LF  change  sheets,  calculate  and  refine  time  allocations, 
and  maintain  departmental  files  of  all  current  POI  and  LP. 

(2)  The  basic  sources  of  material  for  POI  are  the  per- 
formance objectives,  as  expressed  in  the  individual  LP  objective  state- 
ments developed  by  the  responsible  academic  element,  and  the  performance 
objective  workcards  provided  by  the  Evaluation  Unit. 

(3)  The  Chief,  Evaluation  Unit  will  assist  academic  ele- 
ments in  establishing  time  allocations  for  instructional  units  and  con- 
duct research  studies  designed  to  validate  time  allocations.  In  addi- 
tion, the  Evaluation  Unit  will  coordinate  the  preparation,  staffing, 
publication,  and  distribution  of  POI,  provide  performance  objective 
workcards,  and  review  POI  and  LP  change  sheets. 

(4)  Recommendations  for  changes  resulting  from  staffing 
these  documents  will  be  coordinated  by  Chief,  Evaluation  Unit  with  the 
director  of  the  responsible  academic  department,  the  Office  of  Training 
Literature,  and  any  other  academic  or  staff  element  concerned. 

(5)  Classified  POI  will  comply  with  the  provisions  of 
current  security  regulations, 

(6)  The  Assistant  Commandant  will  provide  overall  staff 
supervision  for  the  preparation  of  POI  and  will  approve  each  POI  prior 
to  publication, 

(7)  The  Educational  Consultant  will  advise  and  assist  in 
the  establishment  of  procedures  for  setting  time  allocstions  and  for 
structuring  POI  and  their  components. 

(8)  The  Director  of  Instruction  will  supervise  the  estab- 
lishing of  time  allocations,  the  preparation  of  POI  and  their  components, 
and  assignment  anci  control  of  lesson  plan  digraphs. 

b.  Preparation  of  Draft  Conies. 

(1)  Draft  POI  will  be  prepared  by  the  responsible  academic 
department  in  accordance  with  the  provisions  of  this  chapter,  to  Include 
the  sample  POI  (annex  D),  Coordination  in  preparation  of  the  various 
sections  of  the  document  will  be  initiated  with  other  staff  elements  as 
follows: 

(a)  SECTION  I - Office  of  Plans  and  Programs, 

(b)  SECTION  II  - Evaluation  Unit 

(c)  SECTION  III  - Evaluation  Unit 

(d)  SECTION  IV  - Evaluation  and  MOS  Tasting 

(a)  SECTION  V - Evaluation  Unit 

(2)  After  approval  of  tha  draft  POI  by  tha  Dirac tor  of 
tha  responsible  department  it  will  be  provided  to  the  Director,  Office 
of  Training  Littrature  for  determination  of  doctrinal  Accuracy  and  edi- 
torial correctness , The  document  will  be  returned  to  the  eosdemic 
department  for  correction,  if  required, 

(3)  Chief,  Evaluation  Unit  will  than  review  the  dreft 
document  and  circulete  it  for  further  review  end  coament/concurrence  as 
follows; 
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(a)  Technical  Consul taut 

(b)  Educational  Consultant 

(c)  Director  of  Instruction 

(d)  Assistant  Commandant  (for  approval) 

c.  Preparation  of  Final  Copies.  Upon  completion  of  staffing 
and  approval  of  the  POX  by  the  Assistant  Comnandant,  the  final  POI  will 
be  prepared  on  multi lith  masters  by  Plans  Division,  Office  of  Flans  and 
Programs.  Sufficient  copies  will  be  prepared  to  permit  the  distribution 
currently  required.  The  multilith  masters  will  be  furnished  to  Director 
Office  of  Training  Literature  for  proofreading  prior  to  publication. 

d.  Preparation  and  Filing  of  LP  Containing  Crvptoaaterlal. 

(1)  Director,  Department  3 will  be  responsible  for  prepare 
tion  of  LP  containing  cryptomaterial  and  the  crypto  portion  of  POI  for 
all  enlisted  courses,  except  the  Senior  Nonconmissioned  Officer  Course. 
However,  all  copies  of  approved  LP  and  POI  containing  cryptomaterial 
will  be  filed  with  the  crypto  custodian.  Office  of  Personnel  and  Adminia 
tration,  except  when  in  use  by  an  instructor. 

(2)  Director,  Department  5 will  be  responsible  for 
preparation  of  LP  containing  cryptomaterial  and  uhe  crypto  portion  of 
POI  for  the  Senior  Noncommissioned  Officer  Course,  all  warrant  officer 
and  officer  courses.  However,  all  copies  of  approved  LP  and  POI  con- 
taining cryptomaterial  will  be  filed  with  the  crypto  custodian,  Office 
of  Personnel  and  Administration,  except  when  in  use  by  an  instructor, 

5,  Revision  of  POI  and  LP.  Documents  requiring  revision  due  to 
minor  changes  (ten  percent  or  less  of  total  hours  of  instruction)  will 
be  revised  by  the  appropriate  academic  department,  forwarded  to  the 
Office  of  Training  Literature  for  editing,  and  to  chief,  Evaluation  Unit 
for  final  review.  Upon  approval  by  Chief,  Evaluation  Unit,  documents 
will  be  prepared  in  sufficient  copies  and  distributed  by  means  of  change 
sheets  carrying  the  POI  and/or  LP  identification  numbers.  Change  sheets 
for  POI  and  LP  will  be  numbered  sequentially  and  prepared  in  the  format 
shown  on  page  12-34  of  this  chapter  (annex  E).  Plans  Division,  Office 
of  Plans  and  Programs  is  responsible  for  preparation  of  approved  POI 
change  sheets.  Academic  departments  concerned  are  responsible  for  prep- 
aration of  LP  change  sheets.  Distribution  will  be  the  same  as  that  of 
the  original  POI  or  LP.  Major  POI  and  LP  revisions  (more  than  ten  per- 
cent of  total  hours  of  instruction)  will  be  processed  in  the  manner  pre- 
scribed for  new  POI  and  LP, 

6.  File  Systems  for  POI  and  LP. 

a.  Office  of  Training  Literature  File. 

(1)  The  Training  Literature  file  will  consist  of  an 
original  copy  of  each  POI  and  the  consnand's  record  file  copy  of  each 
supporting  LP  (except  those  dealing  with  cryptomaterial).  The  Training 
Literature  file  will  not  contain  any  testa,  examinations,  evaluations, 
visual  aids,  or  other  training  aid  materials. 

(2)  Removal  of  material  from  the  Training  Literature  file 
must  be  approved  by  the  Direct  'r,  Office  of  Traiulng  Literature. 
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h.  Crvptomtterial  File.  Crypto  Custodian,  Office  of 
Personnel  end  Adminia tret ion  will  maintain  the  ccexaend's  record  file 
copies  of  ell  crypto  POI,  LP,  end  eveluetion  materials  used  by  Evalua- 
tion end  MOS  Teat  Division,  These  documents  end  eveluetion  materials 
will  not  be  releesed  from  file  without  the  epprovel  of  the  crypto  custo- 
dies 

c.  Academic  Department  Files.  Directors,  Academic  Departments 
will  establish  filing  procedures  within  their  respective  activities  to 
Insure  that  copies  of  ell  current  POI  end  LP,  including  revisions,  ere 
available  for  each  of  the  following  files: 

(1)  Department  file. 

(2)  Instructor  file  (LP  only). 

d.  Retirement  of  -221  ELM.- 

(1)  Academic  department  files.  Directors,  Academic 
Departments  will  destroy  all  POI  and  LP  immediately  after  they  have  been 
superseded  or  replaced  by  new  or  revised  documents, 

(2)  Training  Literature  and  cryptomaterial  record  files. 
Director,  Office  of  Training  Literature  and  the  crypto  custodian  will 
retire  the  command's  record  file  copies  of  POI  and  LP  to  the  records 
holding  area.  Coordination  will  be  effected  with  the  Records  Management 
Officer,  this  headquarters.  Documents  retired  will  be  those  LP  super- 
seded or  replaced  by  new  or  revised  plans  and  those  POI  which  have  been 
superseded,  rescinded,  or  discontinued, 

7.  Distribution  of  POI  and  LP  OutBide  the  Command . Requests  from 
organisations  outside  of  this  School  for  POI  and  LP  producad  by  this 
headquarters  will  be  referred  to  the  Director,  Office  of  Academic  Opera- 
tions for  compliance. 
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GUIDE  FOR  THE  PREPARATION  OF  LESSON  PLANS  (LP) 

(See  formet,  peges  12-15  to  12-18.) 

GENERAL 

MARGINS:  Allow  1 inch  (12  spaces)  for  the  left  and  right  margins. 

Leave  at  least  1-1/4  inches  at  the  top  and  bottom  of  each  page. 

PAPER:  LP  will  be  prepared  on  white,  8 x 10-1/2  inch  paper  on  one 
side  only.  Depending  on  the  number  of  copies  required,  they  may  be 
typewritten  for  less  than  10  copies  (white  bond  and  white  tissue 
copies);  or  the  multilith  process  or  914  copy  machine  process  may  be 
used  for  more  than  10  copies. 

PART  I - TITLE  SHEET  AND  AUTHENTICATION  PAGE 
HEADING:  Self-explanatory.  See  example. 

PARAGRAPHING:  See  included  format  (annex  B). 

FILE  NO.:  Enter  the  appropriate  digraph  letters  and  the  LP  number. 

DATE:  Enter  date  LP  is  approved  by  the  approving  authority. 

MOS  PUTT  AND  TASK  IDENTIFICATION;  Enter  the  duty  and  task  numbers/ 
letters  found  on  the  performance  objective  workcards  which  the  LP 
supports. 

TIME  ALLOCATION:  Enter  the  number  of  hours/minutes  allocated  to  the 
LP, 

CLASSIFICATION:  Enter  the  letter  designating  the  security  classification 
of  the  instruction;  e.g.,  (U)  - UNCLASSIFIED:  (c;)  - CONFIDENTIAL: 

(CMHA)  - CONFIDENTIAL  - MODIFIED  HANDLING  AUTHOhlZED:  (S)  - SECRET:  etc. 
TITLE  OF  LESSON:  Enter  the  title  of  the  lesson  and  the  title's  cless- 


lflcstlon. 
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INSTRUCTIONAL  STRATEGY:  Enter  the  primary  end,  if  applicable,  the  eec- 
ondary  instructional  strategy  to  be  used;  e.g,,  Primary  * demonstration, 
Secondary  - performance;  Primary  - programed  instruction,  Secondary  - 
performance;  Primary  - lecture  with  student  response  system;  Primary  * 
computer-based  instructional  system. 

CLASSROOM  OR  AREA  REQUIREMENTS : Specify  what  facilities  (type,  siae, 
etc.)  will  be  required, 

EVALUATION  STRATEGY:  Enter  the  description  of  the  means  to  be  used  to 
check  student  performance  on  this  task,  element,  or  collection  of  ele- 
ments. 

INSTRUCTORS;  List  the  number  of  instructors  and  assistant  instructors 
required. 

TRAINING  AIDS  AND  EQUIPMENT;  List  all  required  training  aids  and  equip- 
ment. 

REFERENCES; 

1,  For  the  Student. 

a.  Study  references  must  be  specific. 

b.  Show  paragraphs  and  pages  as  well  aa  book  or  manual  title. 

2,  For  the  Instructor.  List  references  which  provide  necessary 
background  for  the  instructor. 

3HIP1NI  SUPPLIES  REQUIRED;  List  supplies  the  student  will  be  required  to 
bring  to  cites;  e.g,,  pen,  pencil,  unclassified  notebook,  etc, 

STUDENT  HANDOUTS ; Lift  all  types  of  handouts  (outlines,  advance  ahaata, 
programed  materials,  ate.)  to  be  given  to  students  during  the  class 
meetings. 


TRANSPORTATION:  Ll«t  transportation  requirements,  to  include  tinea  and 


places. 


& 


;CATI0N: 


Bach  LP  will  contain  the  signature  boxes  of  the  preparer, 


and  reviewer;  and  the  approval  boxes  of  the  Department  Director  and  the 
Chief,  Editorial  Division.  Each  item  must  be  completed,  and  the  authen- 
tication will  appear  on  all  copies  of  each  plan  issued.  If  the  reviewer 
is  the  sane  as  the  Individual  preparing  the  plan,  the  statement  in  the 
reviewing  box  will  read,  "Same  as  preparer."  Academic  department  direc- 
tors may  not  further  delegate  their  approving  authority, 

ANNUAL  REVIEW I Each  LP  will  include  three  annual  review  statements. 
These  items  will  be  placed  on  all  copies  of  each  plan  published. 

However,  they  will  not  be  completed  by  the  appropriate  custodian  until 
the  annual  reviews  have  been  accomplished. 


PART  II  - BODY  STYLE 
Title.  Self-explanatory.  See  example. 

Paragraphing.  Paragraph  numbering  and  lettering,  heeding,  and  indenta- 
tion will  be  aa  outlinad  in  the  Style  Manual,  this  headquarters, 

July  1965, 

1,  Arabic  numerals  show  the  phase  of  instruction,  i.e,,  INTRODUC- 
TION, EXPLANATION,  and  SUMMARY.  Type  all  in  CAPS.  From  the  margin, 
indent  five  spaces  and  begin  typing  on  the  sixth  space. 

2.  Lowercase  letters  show  main  teaching  points.  From  margin, 
Indent  9 spaces  and  begin  typing  on  the  10th  space. 
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3.  Arabic  numerals  In  parenthesis  art  used  to  show  facta,  School 
position,  or  other  evidence  supporting  the  main  teaching  points.  From 
margin.  Indent  13  spaces  and  begin  typing  on  the  14th  space.  Block  the 
second  and  succeeding  lines  of  all  paragraphs  in  this  and  lower  subpara- 
graph subdivisions.  (See  Included  sample  LP  format.) 

4.  Lovercase  letters  in  parentheses  are  used  to  shoe  Important 
items  listed  under  arable  nuaarals  In  parentheses.  From  margin,  indent 
18  spaces  and  begin  typing  on  the  19th  space. 

5.  Arabic  numerals  under lined  are  used  to  show  subordinate  data 
and  supporting  information  listed  opposite  lovercase  letters  in  parenthe- 
ses. From  margin,  indent  23  apaces  and  begin  typing  on  24th  apace, 

mum mLssssisLmm. 

The  three  phases  of  a lesaon  will  be  typed  in  accordance  with  the  fol- 
lowing format: 

1,  INTRODUCTION,  The  introduction  sets  the  stage  for  the  lesson 
by  establishing  contact  between  the  Instructor  and  the  class,  arousing 
student  interest,  securing  student  attention,  disclosing  the  nature  of 
the  subject,  and  clarifying  the  objectives. 

a.  Objectives.  The  lesson  plan  objectives  will  be  stated  in 
terms  of  the  following  headings: 

(1)  Student  behavior. 

(2)  Conditions  of  performance, 

(3)  Criterion  of  performance. 

b.  Importance.  This  item  '.onsiete  of  s statement  defining 
the  rasson  for  laarnlng  tha  content  of  the  lesson,  underscoring  the 

importsnee  of  the  materiel  to  the  Individual,  end  ita  ralatiooahip  to 
* particular  NOS  rsguired  duty,  task,  or  alesmnt. 


2.  EXPLANATION,  The  explanation  consltta  of  the  content  mater iala 
and  teaching  point*  required  to  aupport  the  lesson  plan  objective  state- 
ment. The  subject  matter  is  explained,  performance  is  developed,  under- 
standing stimulated,  and  knowledge  is  enhanced.  It  is  a breakout,  in 
terms  of  specific  principles  or  skills,  of  the  content  required  to  achieve 
the  defined  objectives.  Each  group  of  learnings  for  each  objective  end/ 
or  eub-objective  will  be  followed  by  & description  of  ths  technique  of 
evaluation  to  be  used  in  determining  whether  the  performance  standard 
(criterion)  hes  been  net. 

NOTE:  Normally  en  L?  will  include  in  the  EXPLANATION  section, 
ell  training  objectives  for  e specific  learning  set. 
However,  soma  learning  set  perforc&ance  objectives  may 
involve  content  of  such  complexity  and  detail  so  as  to 
produce  en  overeieed  document.  In  such  cases,  separate 
LP  may  ba  prepared  for  subdivisions  of  the  particular 
subject  matter.  All  LP  will  not  necessarily  contain 
separata  sub-objectives  for  etch  teaching  point.  The 
format  shown  here  is  a guide  and  is  not  intended  to 
connote  that  every  heading  used  is  always  required. 

a.  Lecture  Ms t hod.  With  this  method,  the  explanation  consists 
of  a aeries  of  statements  which  logically  develop  the  material  to  be 
learned. 

b.  Conference  Msthod.  Here  the  explanation  consists  of  a 
seriee  of  key  queatlons  and  answers  which  cover  t he  facts,  principles, 
and  concepts  of  the  lesson. 

c.  Demonstration  Msthod.  With  this  method,  the  explanation 
consists  of  a aeries  of  steps  which,  when  demonstrated  by  the  instructor, 
will  present  e visual  image  of  how  an  operation  should  be  perforamd. 
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d,  Ptrfopgwnee  Hat hod.  The  explanation  here  coneiets  of  a 


series  of  step*  which,  when  practiced  by  the  student,  will  result  in  the 
desired  standard  of  performance. 

e.  Programmed  Instruction  Method.  With  this  method,  the 
explanation  consists  of  an  outline  of  the  content  covered  by  the  pro* 
granamad  materiel*. 

3,  SUMMARY.  The  summary  is  a brief  review  of  the  complete  pre* 
sentatlon  containing  chi  following  elements i 

a.  Recapitulation,  this  aleosnt  consists  uf  a brief  repeti- 
tion or  restatement  of  the  main  teaching  points  covered  in  the  lesson. 

b.  Kva lust ion.  In  this  section,  the  mean*  of  determining 
whether  the  student’s  performance  is  go  or  no  go  will  be  described. 

t.  Raemphaais . Hero,  important  ideas  selected  from  the 
teaching  points,  steps  o£  procedure,  or  safety  or  security  pvecautisss 
are  reviewed  for  special  reeaphasie.. 

d.  Closing  Statement,  this  section  consists  of  a strong  con- 
cluding atst*JE*nt  designed  to  leave  with  the  students  a lasting  iapree* 
sion  of  the  importance  of  the  content, 

PART  IV  - PACKET 

Each  L?  will  consist  of  a complete  package  of  all  graphic  ^terisls 
requited  to  conduct  the  instruction,  therefore,  t?  picket  will 
consist  of  a copy  of  each  student  handout,  worksheet,  standard  for**, 
instructor  quU,  and  graphic  training  aid  used  la  the  instruction,  The 
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original  "art  work"  used  for  the  production  of  Vu -Graph  or  35n*»  slides 
will  be  reproduced  in  sufficient  copies  by  means  of  the  ZE&OX  process 
by  the  914  copying  process  to  meet  this  requirement. 
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EXAMPLE  OP  LP  FORMAT 
DIVISION,  DEPARTMENT. 

UNITED  STATES  ARMY  SECURITY  AGENCY  TRAINING  CENTER  AND  SCHOOL 
Fort  Devena,  Maaaachuaetta  01433 

★File  No. ; Data  

MOS  Duty  No. : Taak:  Element: 

Tima  Allocation: 

Claaalflcatlon:  ( ) 

TITLE  OF  LESSON  PUN  (**) 

INSTRUCTIONAL  STRATEGY: 

1.  Primary . 

2,  Sacondary  (If  applicable) . 

CLASSROOM  OR  AREA  REQUIREMENTS: 

EVALUATION  STRATEGY: 

INSTRUCTORS: 

TRAINING  AIDS  AND  EQUIPMENT: 

REFERENCES: 

1.  pot  the  Student, 

2 . For  the  Ina true  tor. 

STUDENT  SUPPLIES  REQUIRED: 

STUDENT  HANDOUTS: 

TRANSPORTATION: 


*TMa  LP  dcea  not  auperiedt  any  LP  currently  In  uaa  at  thia  eehool. 

**Clateification  of  title  and  main  paragraph  headings*  ahould  ba  indicated 
only  in  claeeifiad  laaaon  plana.  If  ciateified,  claaaifieatiQn  would 
a^paar  uhara  paranthaaae  art  now.  If  LP  ia  not  claaaifiad,  thare  would 
ba  no  paranthaaaa  or  olaeelflcation  shown. 
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LESSON  FLAN  AUTHENTICATION  PAGE 


AUTHENTICATION: 


1. 


Prepared  by: 


(Signature) 


(Typed  nane,  grade,  branch  of  service) 


(Typed  title) 


Date: 


2. 


Reviewed 


(Signature) 


(Typed  name,  grade,  branch  of  service) 


(Typed  title) 


Date: 


3. 


Approved  by: 


(Signature) 


(Typed  nane,  grade,  branch  of  service) 


(Typed  title) 


Date: 


EDITORIAL  APPROVAL: 


Approved  by: 


ANNUAL  REVIEW: 


(Signature) 


(Typed  n*a*,  grade,  branch  of  service) 


Date: 


(Typed  title) 


Date: 

Grade /Kane: 

Title: 

Posted: 

Dete: 

By: 

Date: _ 

Grade /Hast: 

Title: 

Tested: 

Date; 

& 

Dete;  

Grtda/f&sa : 

Title: 

Potted: 

Date: 

sy  _ 
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LESSON  PLAN  TITLE 

1.  INTRODUCTION 

a,  Objective. 

(1)  Student  behavior. 

(2)  Conditions  of  parforoance. 

(3)  criterion  of  performance. 

b.  importance. 

2.  EXPLANATION 

a.  yirat  Increment  of  Content. 

(1)  Subobjective. 

(a)  Student  behavior. 

(b)  Conditions  of  performance. 

(c)  Criterion  of  performance. 

(2)  Concent. 

(a)  Fact. 

(b)  Feet, 

(c)  Principle. 

(d)  Skill. 

(3)  Evaluation. 

b.  Second  Increment  of  Content. 

(1)  Subobjactive. 

(e)  Student  behavior. 

(b)  Conditione  of  performance, 

(c)  Criterion  of  performance. 


(2)  Content. 


(a)  Feet. 

(b)  Fact. 

(c)  Principle. 

<d)  Skill. 

(3)  Evaluation, 
c.  •p'trd  Incr*"*nf  o£  Content. 

(1)  Subobjective. 

(a)  Student  behavior. 

(b'y  C&ndittona  of  perfomance. 
(c)  Criterion  of  performance. 
(2)  Content. 

(a)  Fact. 

(b)  Fact. 

(c)  Principle. 

(d)  Skill. 

(3)  Evaluation. 

3,  5WV&  Y 

a.  Pacapltulatlpn. 

b . payfortMnce  Evaluation*.. 

c.  ReatnphaaU.. 

d.  rlo»ins  Statement,. 
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ANNEX  C 


GUIDE  FOR  THE  PREPARATION  OP  PROGRAMS  OF  INSTRUCTION  (POI) 

GENERAL 

MARGINS:  Allow  1 Inch  (12  apacea)  for  the  lift  and  right  aarsina. 
L^v*  at  luit  1*1/4  lnchai  at  tha  top  and  bottota  of  each  page. 
p/?BR;  POI  will  ba  praparad  on  white,  8*1/2  x 13  inch  ptpar  on  ona 
aide  only.  Dapandlng  on  tha  nuiobar  of  copiaa  required,  thay  may  ba 
typewritten  for  laaa  than  10  copiaa  (white  bond  and  white  tiaoue 
copiaa);  or  tha  oultilith  proceaa  or  914  copy  machine  procasa  nay  ba 
uaad  for  more  than  10  copiaa. 

TITLE  -PAGE 

Heading;  Self-explanatory.  Sea  example. 

Month  and  Year:  Self-explanatory. 

POI  Title;  See  format  example  (annex  D), 

MQS  Title  and  M3S  thgabay;  Self-explanatory. 
length;  Self-explanatory. 

Supareaaaion  Inatruetiona;  Begin  in  tha  lower  left-hand  portion  of  the 
P*S«. 

TABLE  OF  CONTENTS 

liat  each  eection  of  the  POI  by  title  in  aequenca. 

SECTION  I - PREFACE 
Coutea;  POI  number  and  MOS  title. 

Purpoaei  the  overall  Job  performance  requiresante  for  the  W08  will  be 
ateted  in  the  objective  teraa  of  behavior,  conditiona,  end  criterion. 
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Proraouliitea:  List  here  all  requirements  that  must  be  met  prior  to 
the  student  entering  the  course,  i.e.,  educational  level,  security 
clearance,  previous  training,  aptitude  scores,  etc. 

Length:  Hours  for  both  peacetime  end  mobilisation. 

Training  Location:  Command  and  geographical  location  where  training  is 
actually  conducted  (i.e.,  USASATC&S,  Fort  Devens). 

MOS  Feeder  Pattern:  See  format  example. 

Ammunition  Requirements:  Self-explanatory. 

Common  Subjects  Recapitulation:  Include  those  required  subjects  that 
are  not  an  Integral  subject  required  for  technical  proficiency  in  the 
MOS,  e.g.,  Counterinsurgency. 

Standardisation  of  Prefix  Diftlt-5  Training.  Seli -explanatory. 
Identification  of  Counterinsurgency  Training:  List  separately  the 
Included  hour*  of  pure  end  integrated  counterinsurgency  training. 

Type  of  Academic  Instruction  and  Instructor  Factors:  Reflect  the  total 
hours  by  type  of  instruction.  The  instructor  end  platform  factors  vill 
be  derived  as  follow#: 

Instructor  Factor. 

Xnatructor  factor  repreeentt  the  average  number  of  instructor  man- 
hours  required  to  teach  each  scheduled  academic  POX  hour  in  each  method 
of  instruction;  e.g,,  the  number  of  Instructor  man-hours  for  each  sched- 
uled POX  lecture  hour  would  be  totalled  and  divided,  to  the  second  deci- 
mal piece,  by  the  number  of  POX  lecture  hours  in  the  courts,  yielding 
the  instructor  factor  for  all  lscturs  hours  in  that  course. 
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Sxaapla. 


Total  acadamic  hours  in  tha  POI—— 368 
Total  lactura  hours — 130 


*113  x 1 instructor  taan-hour  ■ 113  man-hours 

17  x 3 instructor  man-hours  - 51  man-hours 

164  man-hours 

164  dividad  by  130  - 1.26  Instructor  factor. 

Total  PE  hours— ------ — - — — — -193 

20  x 3 Instructor  man-hours  » 60  man-hours 

178  x 5 Instructor  man-hours  - 890  man-hours 

950  man-hours 

950  dividad  by  198  ■ 4.80  Instructor  factor. 


Total  Bxam/Daoonstratlon/TP  hours-— ——40 
2x1  instructor  man-hours  • 2.00  man-hours 

13  x 2 instructor  man-hours  • 26.00  man-hours 

25  x 3 instructor  man-hours  • 75.00  man-hours 


103.00  man-hours 

103  dividad  by  40  » 2.58  instructor  factor. 

Instructor  Factors 

L - 1.26 
PE  - 4.80 
S - 2.58 

*Of  tha  130  lactura  hours,  113  raquira  only  1 instructor  par  POI-hour, 
and  17  raquira  3 instructors  par  POI-hour. 
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Platform  Factor. 


thla  factor  actually  represents  a relationship  between  the  number 
of  hours  an  instructor  can  teach  per  day  for  a given  course  of  instruc- 
tion, and  the  total  number  of  teaching  hours  available  per  day,  In  cer- 
tain FOI  subjects  one  instructor  ma.<  be  capable  of  teaching  6 hours  par 
day  without  losing  his  effectiveness.  There  are  other  situations  (such 
as  teaching  difficult  technical  subjects)  where  us  little  as  3 hours  on 
the  platform  per  day  is  considered  an  optimum  workload.  If  it  is  deter- 
mined that  due  to  the  complexity  of  the  material  being  presented,  en 
instructor  can  teach  6 hours  per  dsy  end  there  are  8 hours  available  per 
day,  the  platform  factor  is  8 divided  by  6 or  1.3. 

Recapitulation  by  Security  Classification;  Reflect  the  total  number  of 
hours  within  each  security  classification. 

Summary; 

U Academic  Time.  Reflect  only  that  time  utilised  in  an  instruc- 
tional mode.  Separate  entries  will  be  mads  for  M05  supporting  and 
common  subjects,  non-KQS  supporting, 

2.  Non-acadtaic  Time.  The  Director,  Office  of  Plans  end  Programs 
provides  authorised  times  for  each  of  the  categories  based  on  the  aca- 
demic time  requirement  ss  shown  in  format 

SECTION  II  - JOB  PERFORM*  WC-E  Rf QUIRKKBNTS 
The  duties,  tasks,  and  elements  of  the  overall  field  job  require- 
ments ere  enumerated  in  behavioral  tarns.  The  source  of  information  for 
this  section  is  the  performance  objective  wovkcards  developed  from  Job 
analysis  data  and  provided  by  the  Evaluation  Unit  to  tne  academic 
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department*.  Duties  ere  Identified  by  Rosen  nuteerele,  tasks  by  capital 
letters,  end  eleaente  by  arable  number#.  Example:  Duty  X,  Task  B, 
distant  3. 

Note;  For  MDS  Q'K  end  98C,  only  the  title  of  the  duties,  teaks, 
and  elements,  which  ere  baaed  on  fir at  generation  Job 
analysis  date,  need  be  shown.  Subsequent  POX  for  theae 
JCS' • will  express  Job  performance  requirements. 

SECTION  XXI  - THAINIHG  PERroRH\NCB-0BJI£TlV8S. 

This  section  is  a conaolidation  of  the  performance  objectives  as 
expressed  In  each  of  the  course  lesson  plans  in  the  sequence  in  which 
they  will  appear  in  the  course  of  instruction,  k columnar  arrangement 
will  be  used  as  follows  (see  format  example): 

Column  1 - Lesson  Plan  File  No. 

Column  2 - Classification. 

Column  3 - UP  Time,  and  Type  Instruction.  (The  LP  time  may 
be  shown  in  hours  or  minutes  as  appropriate  for 
the  particular  POX.  However,  ell  time  references 
should  be  consistent.  If  time  is  reflected  in 
minute*  for  one  LP,  than  all  LP  time  allocations 
will  be  expressed  in  minutes. 

Column  4 - LP  Title  end  Performance  Objective,  this  relates 
whet  the  student  oust  be  able  to  do  ea  a result  of 
receiving  the  instruction. 

Column  5 - Job  References.  Each  leaeon  plan  will  be  cross* 
referenced  to  the  Job  requirements  that  are 


supported  by  the  lesson  plan.  References  will  be 
aide  by  using  the  duty,  tank,  and  slensant  Identi- 
fication as  contained  in  section  II  (e.g.,  XIC2  - 
Duty  II,  Task  C,  Element  2). 

Column  6 - Content  References.  Include  any  official  publica- 
tions, manuals,  etc,,  which  were  used  to  develop 
the  lesson  content  materials  (e.g.,  OTD  10-4). 

SECTION  IV  - PERFORMANCE  EVALUATIONS  FOR  

(Use  title  of  course.) 

Tnis  section  is  intended  to  show  the  type  and  scope  of  measuring 
instruments  that  ere  ueed  es  the  basic  for  determining  student  develop- 
ment end  level  of  proficiency.  Reference  is  to  those  evaluations  devel- 
oped by  Evaluation  and  K)S  Test  Division  (E&HT)  which  ere  edminietared 
at  critical  Junctures  during,  end  st  the  end  of  the  course,  which  ere 
ueed  ee  "go"  or  "no-go"  criteria.  The  individual  lesson  plan  evalua- 
tions (department  developed  Internal  avaluatlons)  need  not  be  included. 
The  arrangement  o?  thia  eaction  is  columnar  (aee  format  example): 

Column  l - Evaluation  Identification.  The  file  number  aaeigned 
to  the  evaluation. 

Column  2 - Classification,  Saif -explanatory. 

Coliam  3 - Strategy  Died,  Eotar  multiple  choice,  true-felae, 
performance,  etc,,  at  appropriate. 

Column  4 - Scope.  Enter  the  leeeon  plan  file  numbers,  ths 
contents  of  which  ere  included  in  the  evaluation. 

Column  5 - Tima,  luctr  the  time  required  to  administer  the 
evaluation. 
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Colusa  6 - Week.  Enter  the  week  of  training  during  which  the 
evaluation  la  administered, 

SECTION  V - 1EQUEMCE  OF  INSIRtKHOK  AND  CI/SSROOM  REQUIREMENTS 
Thla  section  will  liet  leaaon  plan  file  nuahere  and  titles  in 
the  order  In  which  they  are  introduced  in  rhe  course.  It  la  understood 
that  soma  lesson  plans  cover  large  blocks  of  hours  and  will  be  inter- 
spersed throughout  the  course.  The  academic  element  may  anter  such  a 
lesson  plan  each  time  it  is  used  if  considered  appropriate  to  do  so. 

The  classroom/ training  araa  requirements  for  aach  laaaon  plan  will 
bs  included  and  will  show  any  apeclel  requirements.  For  eitasple,  an 
equipment  leaeon  plan  may  require  the  uae  of  a c Intercom  that  has  s min- 
imise number  of  s particular  type  of  installed  equipment. 
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ANNEX  D 


EXAMPLE  OF  POl  FORMAT 


Month  Tsav 

PROGRAM  OF  INSTRUCTION 
FOR 

POX  NUMBER 
NOS  TITLE 
MOS  NUMBER 

launch:  Paacsciaa  - t»Qka  __  days 

Mobilisation  - uaaka  ...  days 


This  FOX  au$ar§*d*t  . ...  for  ths  

(No,)  (Haas  of  court*)  (data) 


IHi 


TABLE  OF  CONTENTS 


NOS  Tit It  - NOS  Nuabtr 


SECTION  I Prtftct 

SECTION  II Job  Ptrforatnct  Rtquirtotnti- 

SECTION  III--- — ——Training  Ptrforatnct  Objtctivet 
SECTION  IV— ----Ptrforatnct  Evaluation 

SECTION  V— — -Saqutncn  of  Instruction  tn«i  elattrooo  Rtquirtotntt 
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SBC TIOW  I — PREFACE 
WPS  Tide  - NOS  Number 

i 

A.  Course:  (Enter  nvsaber  end  tide  of  th©  course.) 

B . Purpoee : 

1.  Job  Performance  Objectives 
e . Behavior : 

b.  Condition  of  Performance: 

c.  Criterion  of  Performance: 

2,  NDS  for  which  ttafted  (Enter  title  and  NOS  number.) 

C.  Prerequisites:  (Enter  aptitude  and  administrative  prerequisites.) 

D.  Length:  peacetime  hob ill tat ion 

Hours  Hours 

(Based  on  hours  of  instruction  per  week) 

E.  Training  Location: 
t.  NOS  Paeder  pattern: 

Prerequisite  M03  NOS  Trained  in  this  Courts  Feeds  Following  NOS 

G.  Ammunition  Requirements: 

H.  Common  Subjects  Recapitulation: 

I.  Standardisation  of  Prefix  Digit-5  Training: 

J.  Identification  of  Countar insurgency  Training: 

K.  Type  of  Academic  Instruction  and  Xoatructor  Factors: 

l.  Type  of  Instruction  Hour* 

Lecture 
Conference 
Demons tret ion 
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Film 


Practical  Exercise 
Programed  Instruction 
Criterion  Evaluation 
2.  Manpower  Requirement  Factors 

a.  Instructor  Factor: 

(List  only  those  types  of  instruction  utilised  within  the 
course . ) 

b.  Platform  Factor: 

L.  Recapitulation  by  Security  Classification:  Hours 

(List  by  category  only  those  classifications  used  in  the  course. 
Nonacademic  time  will  be  included  in  the  unclassified  category.) 

M.  Sumner y: 

1.  Academic  Time  Hours 

a.  MOS  Supporting: 

b.  General  Military: 

2.  Nonacademic  Time  Hours 

Paace/Mobilisation 

a.  Inproceaaing: 

b.  Coprocessing: 

c . Commandant ' s Time : 

d.  Open  Tims: 

e.  Physical  Training: 
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SECTION  II  - JOB  PERFORMANCE  REQUIREMENTS 
NOS  Tiwlj  - NOS  Huaber 


Elit a_I: 

Behevior: 

Condition: 

Criterion: 

TMk  A: 

Behavior: 
Condition: 
Criterion: 
g lenten  t 1: 

Behevior: 
Condition: 
Criterion: 
EUttont  2: 

Behevior: 

Condition: 

Criterion: 

Behevior : 

Condition: 

Criterion: 

TMk  A: 

Behevior: 
Condition: 
Criterion t 
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Klgagnt  1; 


Bahsvior : 

Condition 

Criterion 


SECTION  IV  - PERFORMANCE  EVALUATIONS  FOR  (Us*  Title  of  Course) 
MOS  Title  - MOS  Number 

EVALUATION  UmWr  STRATEGY  USED  SCOPE  TEE 

IDENTIFICA-  CATION 

TION 


SECTION  V - SEQUENCE  OF  INSTRUCTION  AND  CLASSROOM  REQUIREMENTS 

MOS  Title  - MDS  Number 


mmjm 
mg  -a. 


mojQMOIXLK  CIAMBfigN 

smbimto 
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ANNEX  S 

EXAMPLE  OP  POI/LP  CHANGE  SHEET 
^ DIVISION,  DEPARTMENT,. 

UNITED  STATES  ARM?  SECURITY  AGENCY  TRAINING  CENTER  AND  SCHOOL 
Fort  Davans,  Ma(«achu**tt*  01433 

CHANGE  NO,  1 Data  

POI.LP  NO.  (Data) 

POI/LP  Titl* 

Citad  POI/LP  will  ba  changad  aa  follow*: 

1.  Faja  2.  Raaova  paga  2 and  lnaart  ravlaad  paga  2. 

2.  Fag*  3.  Mak*  tha  following  pan-and-ink  changaa: 


1 Incl  RICHARD  J.  CLARK 

Ravlaad  paga  2 LTC,  AIS 

Dir,  Dept  _ 

DISTRIBUTION; 

Tach  Con 
Ch,  Eval  Unit 
Dir,  Tng  Lit 

Dir,  Dapt  - 3 ey 

1 - Dapt  Pll* 

1 - Inatructor'a  Pil*  (LP  only) 

1 - Monitor1 a Daak  Flla  (L?  only) 

POSTED: 

Data:  _ By: 


(Saa  lnatructlona  on  next  paga.) 
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CHANGE  SHEET  INSTRUCTIONS 


No  changes  will  b«  made  to  an  approved  POI  and  LP  unlaaa  a change  sheet 
effecting  such  change  has  been  issued. 

1.  Changes  to  each  document  will  be  made  by  means  of  change  sheets, 
numbered  serially. 

2.  Change  numbers  will  be  identified  as  fol  owss 

a.  g&at  - list  the  change  number. 

b.  Second  - list  the  POI/LP  number  followed  in  parentheses 
by  the  date  of  the  document. 

3.  All  change  sheets  must  be  dated  to  show  the  date  that  the  change 
sheet  was  Issued. 

4.  Change  sheets  will  be  signed,  personal 1>  , by  the  department 
director. 

5.  Distribution  of  change  sheets  will  be  shown. 

6.  Posted  statement  will  be  listed  and  will  be  completed  by 
recipients  of  change  sheets. 


CHAPTER  13 


EVALUATING  INSTRUCTIONAL  SYSTEMS 
A,  INTRODUCTION 


1,  Purpose.  All  efforts  up  to  thla  point  have  bean  focuaad  on 
the  praparation  of  plana  and  materlala  to  conduct  a courae  of  inatruc- 
tion.  Now  tha  inatructional  system  tauat  be  subjected  to  tryout  and 
evaluation  to  determine  tha  affectiveneaa  of  tha  system  and  each  of 
lta  component#  in  operation.  Although  conducive  proof  of  tha  ade- 
quacy of  the  ayatem  can  only  be  obtained  by  followup  and  evaluation 

of  graduataa  on  the  job,  obaervatlon  of  the  ayatem  in  action  can  pro- 
vide valuable  data  for  improvement.  The  purpoae  of  thla  chapter, 
therefore,  ia  to  identify  praclaely  what  is  to  be  evaluated,  who  will 
do  the  evaluating,  and  whan  and  how  the  evaluation  ia  to  be  done. 

2.  Components  of  a Learning  Situation  to  be  Kyiluafd,  A learn- 
ing situation  lnvolvaa  atudenta,  lnatructora,  course  content,  sequence, 
time  allocations,  inatructional  strategies,  materials,  equipment,  and 
facilities.  If  any  one  of  these  components  is  substandard,  tha  inatruc- 
tional program  cannot  be  maximally  affective  in  achieving  the  dealred 
goala. 

a.  Students.  Regardless  of  the  skill  with  which  an  instruc- 
tional system  has  bean  designed,  tha  training  program  will  fail  unless 
the  student  input  matches  tha  target  population  of  the  system.  All 
training  courses  have  prerequisites.  If  students  do  not  possess  the 
prerequisite  aptitudes,  skills,  and  knowledges,  they  are  not  ready  for 
the  course  as  designed.  They  will  not  be  able  to  acquire  the  Job 
skills  and  knowledges  tha  system  aims  to  develop--at  least  not  with  the 
materials  provided  and  within  the  time  frame  established.  If  it  is 
discovered  that  the  typical  student  does  not  measure  up  to  the  prerequi- 
sites set  for  a particular  course,  changes  "mat  be  made  in  the  course 
to  accommodate  the  lower  quality  input,  or  the  pteraquisitss  themselves 
oust  bs  changed.  Close  study  end  sbaervation  of  the  pilot  classes  la 
therefore  nac<sa«ary  to  determine  the  compatibility  of  the  input  end  the 
instructional  system. 

b-  Instructors.  Even  the  best  instructional  strategy,  facil- 
ities, squipmsnt,  end  materials  will  fall  to  produce  the  required  job 
skills  if  substandard  instructors  implement  tha  progress  The  instruc- 
tor is  ons  of  ths  ksy  components  of  e training  system.  He  must  possess 
ths  tschnicsl  end  pedagogical  knowledge  end  ekills  end  be  highly  moti- 
vated if  ha  is  to  bs  succassful  in  using  the  strategies,  materials,  and 
squipmsnt  salected  or  produetd  during  the  syetea  planning  phase.  By 
observing  instructors  as  thay  work  with  the  other  eyttem  components,  it 
i»  possible  to  get  some  leads  as  to  possible  deficiencies  in  ths  tyetem. 
At  least  it  will  bs  possible  to  identify  instances  where  the  faulty  pert 
of  the  system  is  the  instructor. 
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c.  Course  Content,  the  selection  of  course  content  is  largely 
a Judgmental  procedure.  Although  in  the  final  analysis , the  adequacy 

of  content  taught,  In  terms  of  both  amount  and  kind,  can  only  be  deter- 
mined by  evaluating  the  man  on  the  Job,  much  useful  data  can  ba  gathered 
by  listening  and  observing  as  the  content  is  presented.  During  the 
development  of  instructional  materials,  every  effort  is  made  to  avoid 
unnecessary  duplication  of  content  and  conflicts  in  concepts  and  doc- 
trine. However,  discrepancies  are  bound  to  occur  and  these  weaknesses 
must  be  Identified  and  eliminated.  Classroom  observation  is  a meant  of 
doing  thia.  In  addition,  the  appropriateness  and  level  of  the  content 
presented  can  also  be  Judged  by  observing  the  students  end  the  instruc- 
tors as  they  work  with  the  materials. 

d.  Sequence  and  Time  Allocations.  The  only  practical  way  to 
determine  the  correctness  of  the  sequence  of  instruction  and  the  time 
allotted  to  each  block  of  instruction  ia  to  subject  these  elements  of 
the  system  to  actual  trial.  Students  will  quick lv  note  blatant  errors 
in  sequencing  because  they  will  not  possess  the  required  learnings  to 
deal  with  the  new  material.  Instructors  will  easily  note  cases  of 
Improper  time  allocation  when  they  attempt  to  cover  the  materials  and 
develop  the  Job  knowledges  and  skills.  The  comments  of  both  students 
and  Instructors,  as  well  as  the  observations  of  an  outside  evaluator, 
will  provide  the  data  needed  to  improve  both  sequencing  and  time  alloca- 
tions, 

e.  Instructional  Strategies.  The  most  objective  method  of 
determining  the  optimum  instructional  strategy  is  to  conduct  experi- 
mental studies  in  which  different  strategies  are  compared.  This  is  an 
expensive  and  time-consuming  procedure.  None-the-less,  such  studies  will 
be  conducted.  But,  the  numbar  of  controlled  studies  that  can  be  con- 
ducted is  limited  by  personnel,  time,  and  funds.  For  this  reason,  much 
of  tha  initial  data  pertaining  to  tha  adequacy  ot  the  instructional 
strategy  selected  for  presenting  a block  of  instruction  must  be  obtained 
by  observation  of  the  system  in  action.  Tha  judgments  of  qualified  and 
trained  observers  will  be  used  to  collect  these  data, 

*•  Materials.  Kgaipmant^  and  Facilities,  judgments  about  the 
adequacy  of  materials,  equipment,  and  instructional  facilities  can  be 
made  prior  to  the  launching  of  instruction.  However,  to  obtain  valid 
Judgments  relating  to  the  appropriateness  of  these  system  components, 
both  in  terms  of  kind  and  amount,  requires  observation  of  an  on-going 
learning  situation.  Part  of  the  Job  of  an  observer  will  be  to  note 
deficiencies  In  these  areaa  and  make  recommendations  for  Improvement. 

3.  Perspective  Heeded  for  Complete  Evaluation.  An  instructional 
system  can  ba  evaluated  from  several  different  and  complementary  per- 
spectives. Unfortunately,  in  the  great  majority  of  training  programs, 
the  only  point  of  view  represented  is  that  of  an  outsider,  a member  of 
the  staff  or  faculty,  who  is  not  directly  involved  in  the  learning  situ- 
atlon.  While  this  type  of  evaluation  is  necessary,  it  cannot  provide 
complete  data  on  the  effectiveness  and  efficiency  of  the  system.  Two 
additional  perspectives  are  needed]  the  observations  and  evaluation 
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by  students  and  instructor*,  both  >f  whom  are  integral  parts  of  the 
learning  situation.  With  careful  planning  and  adequate  controls,  these 
groups  can  provide  Information  and  recommendations  of  great  value  in 
revising  and  improving  an  Instructional  system. 

4.  Pitfalls  in  Evaluation.  Too  often,  programs  of  evaluation, 
based  on  observation  and  opinion  surveys,  have  failed.  Mainly  these 
failures  can  bo  attributed  to  inadequate  planning,  lack  of  objectivity, 
improper  interpretation  of  findings,  and  inappropriate  use  of  results. 
Poor  systems  of  evaluation  produce  anxiety,  resentment,  or  efforts  to 
sabotage  the  program.  Here  are  some  of  the  most  common  pitfalls  in  each 
of  these  categories. 

a.  Planning. 

(1)  Failure  to  work  out  the  details  of  the  program,  to 
include  data  collection  instruments,  specific  procedures  to  be  followed, 
and  the  timing  of  observations,  surveys,  and  Interviews. 

(2)  Failure  to  train  evaluators  in  the  principles  and 
techniques  of  evaluation,  Including  the  use  of  date -gathering  instru- 
ments. 

(3)  Failure  to  make  clear  to  all  concerned  the  purpose* 
of  the  evaluation  program  and  the  uses  to  be  made  of  evaluations  and 
recommendations . 

b.  Lack  of  Oblectivitv. 

(1)  Failure  to  select  evaluators  who  are  impartial  and 
capable  of  making  objective  judgments. 

(2)  Failure  to  look  at  all  of  the  componanti  of  tha 
learning  situation  as  an  Integrated  system. 

(3)  Focusing  on  unimportant  detail*  and  "nit-picking" 

instructors . 

c.  Improper  Interpretation, 

(1)  Assuming  that  consensus  among  observers  of  one  cate- 
gory (a.g.,  students)  guarantees  a valid  judgment. 

(2)  Concluding  that  an  observation  or  judgment  made  by 
only  ona  observer  is  inaccurate  or  invalid . 

(3)  Taking  comment#  at  face  value,  and  not  coneidaring 
the  nuances  of  language,  and  the  problem  of  semantics. 

(4)  Failing  to  take  into  consideration  the  perspective 
of  the  individual  making  the  observation. 

d.  Inappropriate  Use . 

(1)  Using  reports  of  observation  and  evaluation  as  the 
basis  for  disciplinary  actions. 

(2)  Using  reports  a basis  for  denying  pmeotion  or 
special  privileges. 

(3)  Using  otherwise  unsupported  and  unvalidatud  observa- 
tions as  a basis  for  making  significant  changes  to  an  instructional 

system. 


B.  OBJECTIVES  OF  THE  EVALUATION  PROGRAM 


1.  Primary  Oblectlve.  The  primary  and  overriding  objactiva  of 
cha  program  of  instructional  evaluation  la  to  collect  data  which  will 
serve  as  a valid  basis  for  revising  and  improving  instructional  systems. 
The  evaluation  of  Instructors  separately  and  distinctly  from  other  sys- 
tem components  is  not  the  objective.  Instructors  will  be  evaluated  as 
one  of  the  system  components  interacting  with  all  of  the  others. 

2.  Secondary  Objectives.  There  are  several  secondary  objectives 
which  an  evaluation  program  must  serve.  These  aie  as  follows: 

a.  To  Insure  that  instruction  is  conducted  in  a manner  con- 
sistent with  the  system  as  designed.  There  must  be  some  means  of  insur- 
ing that  the  system  as  observed  is  the  same  as  that  planned;  radical 
departures  from  the  planned  system  cannot  be  allowed  because  the  valid- 
ity and  ef fectivenees  of  the  system  cannot  be  checked  under  these  cir- 
cumstances, 

b.  To  provide  a basis  for  Instructor  iuservice  training  and 
upgrading.  An  lnservice  or  upgrading  program  for  instructors  must  be 
based  on  observed  needs.  Data  collected  by  qualified  and  objective 
observers  can  well  serve  to  identify  areas  in  which  additional  training 
for  Instructors  can  be  scheduled, 

c.  To  provide  data  which  are  usable  in  effecting  revisions 
of  the  Instructor  Training  Course.  Objective  observation  can  reveal 
common  deficiencies  among  Instructors  which  can  be  remedied  by  changes 
in  the  Instructor  Training  Program. 


C . PROCEDURES 


Twining  and  Assigning  Evaluators. 

a.  Evaluators  assigned  to  the  Evaluation  Unit  (EU)  will  under- 
go special  training  in  the  techniques  of  observation  prior  to  making 
evaluation  visits.  This  training  will  be  provided  by  Chief,  Evaluation 
Unit. 

b.  Evaluation  of  specific  courses  of  instruction  will  be  per- 
formed by  those  evaluators  who  performed  the  job  analysis  of  the  MOS 
concerned.  They  may  request  the  assistance  of  other  members  of  the 
staff  when  needed. 

2.  Briefing  Students  and  Faculty. 

a.  Chief,  Evaluation  Unit  will  provide  separate  briefings  for 
students  in  each  pilot  course  and  for  personnel  who  will  instruct  in 
these  courses. 

b.  The  briefings  will  define  the  purposes  of  the  evaluation 
program,  responsibilities,  specific  procedures  to  be  used  (including  the 
data  gathering  instruments),  pitfalls  to  avoid,  mid  the  uses  to  be  made 
of  the  reports  rendered. 
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3.  Scheduling. 

a.  Claaarooro  Observation. 

(1)  Evaluators  (EU)  will  observe  as  many  classes  as  pos- 
sible during  the  conduct  of  each  pilot  course.  As  a minimum,  at  least 
23  per  cent  of  all  classes  will  be  evaluated. 

(2)  In  preparing  for  evaluation,  evaluators  will  insure 
that  all  critical  points  in  the  instructional  sequence  are  observed  and 
that  an  adequate  sample  of  all  other  instruction  is  included. 

(a)  "Critical  points"  are  defined  as  points  in  the 
instruction  where  students  perform  some  Important  job  task  or  element 
of  skill  which  is  Judged  as  go  or  no-go. 

(b)  An  "adequate  sample"  of  other  instruction  is 
defined  as  enough  additional  observation  of  day-to-day  Instruction  to 
obtain  a clear  picture  of  the  interactions  of  all  system  components 
leading  up  to  the  critical  performances. 

b.  Student  Opinion  Surveys. 

(1)  At  the  conclusion  of  selected  blocks  of  instruction, 
Chief,  Evaluation  Unit  will  administer  a student  opinion  survey  to  the 
pilot  class  using  the  instrument  shown  at  annex  A. 

(2)  Additional  opinion  surveys  may  be  made  of  shorter 
blocks  of  instruction  on  request  of  the  Director  of  Instruction.  The 
standard  form  at  annex  A may  be  used  or  special  forma  may  be  prepared 
if  required. 

c.  Student  Interviews. 

(1)  During  the  progress  of  each  pilot  course,  evaluators 
(EU)  will  conduct  interviews  with  a random  sample  of  10  per  cent  of  the 
class  enrollment  using  the  form  at  annex  B to  report  results. 

(2)  Interviews  may  also  be  scheduled  by  the  Academic 
Department  Director.  The  standard  form  et  annex  B may  be  used  to  report 
results. 

d.  Instructor  Surveys. 

(1)  At  the  conclusion  of  selected  blocks  of  Instruction, 
Chief,  Evaluation  Unit  will  administer  the  form  at  annex  A to  all  per- 
sonnel who  conducted  instruction  in  that  instructional  unit, 

(2)  Additional  instructor  surveys  may  be  administered 
upon  request  of  the  Director  of  Instruction. 

e.  Instructor  Interviews. 

(1)  At  th*  conclusion  of  selected  blocks  of  instruction, 
Chief,  Evaluation  Unit  will  conduct  interviews  with  th*  senior  instructor 
of  each  academic  element  involved  and  report  reeults  on  ths  form  shown 

sc  annex  B. 

(2)  Additional  instructors  may  be  intervitved  on  request 

of  the  Diviaion  Chief  concerned,  again  using  the  standard  form  for  report- 
ing purposes. 

4.  Techniques  0f  classroom  Observation.  Evaluators  will: 

s.  Review  the  lesson  plan  and  supporting  materials  prior  to 
arrival  in  the  classroom  or  training  area. 
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b.  Arrive  In  the  classroom  or  training  area  before  instruc- 
tion begins  and  remain  long  enough  to  get  a clear  picture  of  the  learn- 
ing situation. 

c.  Make  every  effort  to  avoid  being  a distraction  to  either 
the  Instructor  or  the  srudents. 

d.  Refrain  from  consenting  on  either  content  or  procedures 
during  the  presentation. 

e.  Guard  against  display  of  disagreement,  displeasure,  or 
boredom  by  facial  expression,  gestures,  or  posture. 

f.  Convey  an  attitude  of  interest,  attention,  and  objectivity. 

g.  Focus  their  attention  on  each  component  of  the  learning 
situation  but  pay  particular  attention  to  student  reaction. 

h.  Complete  the  evaluation  form  (see  Annex  A)  immediately 
after  the  visit. 


5.  Techniques  of  Interviewing.  Interviewers  will: 

a.  Allow  a minimum  of  30  mlnutea  for  each  interview. 

b.  Review  the  records  of  the  Interviewee  prior  to  the  meet- 


ing. 

c.  Conduct  the  Interview  in  a place  that  is  private  and  free 
from  the  distractions  of  noise  and  interruptions. 

d.  Establish  a friendly,  cooperative,  working  relationship 
with  the  interviewee. 

e.  Deal  with  the  Interviewee  in  a forthright  sincere  manner 
and  listen  attentively  to  hla  comments. 

f.  Avoid  evidences  of  pressure,  boredom,  and  irritation;  be 

patient. 


g.  Avoid  antagonising,  embarrassing,  or  hurrying  the  inter- 
viewee. 


h.  Display  an  objective  but  not  a disinterested  attitude, 

I.  Accept,  unperturbed,  expressions  of  negative  feelings,  such 
as  hostility  and  highly  subjective  criticism, 

J.  Encourage  the  interviewee  to  state  his  views  completely  and 
without  fear  of  censure  or  reprisal  for  honest  criticism, 

k.  Raise  questions  to  elicit  responses  about  areas  not  covered 
in  the  interviewee's  comments;  e.g,,  adequacy  of  classroom  facilities, 
scheduling,  equipment,  etc. 

l.  Sunvnarlse  the  main  points  made  to  be  certain  that  he  has 

a clear  and  complete  picture  of  the  interviewee's  observation  and  evalu- 
ation. 


m.  Complete  the  interview  form  immediately  following  the  inter 

view. 


6.  Instructor  Evaluation. 

e.  At  the  conclusion  of  selected  blocks  of  instruction, 
Chief,  Evaluation  Unit  will  distribute  copies  of  the  questionnaire 
at  annex  B,  to  all  instructors  who  conducted  instruction  during  the 
instructional  unit. 
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b.  Instructors  will  complete  the  form  and  return  it  to  Chief, 
Evaluation  Unit. 

c.  Followup  interviews  with  Instructors  will  be  coordinated 
with  the  Department  Director  concerned  and  with  the  Director  of 
Instruction.  Such  Interviews  will  be  conducted  by  the  KU  evaluator 
designated  as  project  officer  for  the  NOS  course  concerned. 

d.  Reports  of  interview  will  ba  prepared  in  the  format  shown 
at  annex  B. 

7.  Student  Evaluation. 

a.  At  the  conclusion  of  selected  blocks  of  instruction, 

Chief,  Evaluation  Unit  will  distribute  copies  of  the  questionnaire  at 
annex  A to  all  members  of  the  pilot  class. 

b.  Students  will  complete  and  sign  the  forma  and  return  them 
to  Chief,  Evaluation  Unit. 

8.  Tabulating.  Interpreting,  and  Reporting  Survey  and  Interviaw 

Results.  ~ 

a.  Student  opinion  and  instructor  surveys  will  be  forwarded 
to  Chief,  Evaluation  Unit  for  tabulation,  analysis,  Interpretation,  and 
reporting. 

b.  Student  and  instructor  interview  forma  will  be  forwarded 
by  interviewer!  to  Chief,  Evaluation  Unit  for  analysis,  interpretation, 
and  the  preparation  of  a summary  report. 

c.  Reports  of  observations  of  classroom  instruction  will  be 
forwarded  to  chief,  Evaluation  Unit  for  tabulation,  interpretation,  and 
preparation  of  summarising  reports. 

9.  Routing  and  Distribution  of  Reports.  Copies  of  reports  of 
observation,  evaluation  and  interview,  complete  with  recommendations 
will  be  distributed  as  follows: 

a.  Evaluation  Unit  file  - original. 

b.  Director  of  Instruction  * one  copy. 

c.  Director,  Monitoring  Departoant  * one  copy. 

d.  Chief,  Monitoring  Division  - one  copy. 

a.  Director,  Inatructing  Department  (if  different  from  moni- 
tor ) - one  copy. 

f.  Chief,  Instructing  Division  (if  different  from  monitor)  - 

one  copy, 

g.  Technics!  and  Educational  Consultants  - one  copy  (Info). 

10 . Intradepartpental  Instructional  Evaluation  Program. 

a.  The  Director  of  Instruction  will  initiate  end  supervise  a 
revitalised  program  of  intradepartotntal  instructional  evaluation. 

b.  Chief,  Instructional  Methods  Division  will  develop  end  con- 
duct e training  program  designed  to  ptepare  departmental  supervisory 
personnel  (officers,  MCO’s  end  civilians)  for  tha  evaluation  of  instruc- 
tional systems  using  the  techniques  of  observation  end  interviewing  pre- 
scribed herein. 
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c.  Department  Directors  vill  schedule  and  conduct  observa- 
tions and  interviews  as  directed  by  the  director  of  Instruction, 

d.  Observations  and  interviews  will  be  conducted  by  depart- 
mental supervisory  personnel  in  accordance  with  the  procedures  and 
standard  forms  prescribed  in  this  chapter. 

a.  Report  o2  observation  and  interview  will  be  distributed 
as  directed  by  the  Director  or  Instruction. 
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ANNEX  A 


REPORT  OP  EVALUATION 

Course  _________ _________ ___ Date 

Instructional  Unit Instructional  Unit  ___ __ 

or  or 

Lesson  Plan  No.  Lesson  Plan  Title  


Department  _______  Division  _____  Instructor  _________________________ 

Directions:  For  each  item  listed  below,  circle  the  word  which 
best  describes  your  evaluation  of  the  system  com- 
ponent or  characteristic.  Explain  in  the  Remarks 
Section,  all  items  circled  in  columns  1 end  2. 


Item 

1 

2 

3 

1.  Students'  aptitude  for 
the  instruction 

Lacking 

Questionable 

Adequate 

2.  Students'  readiness  for 
ths  instruction  (in  terms 
of  background  and  experience) 

Lacking 

Questionable 

Adequate 

Students'  motivation  and 
interest 

Lacking 

Questionable 

Adequate 

4,  Instructor's  knowledge  of 
subject-matter 

Inadequate 

Questionable 

Adequate 

3.  Instructor's  teaching  skills 

Inadequate 

Questionable 

Adequate 

6.  Relationship  between  cortent 
and  objectives 

Inconsistent 

Questionable 

Consistent 

7.  Accuracy  of  content 

Inaccurate 

Questionable 

Accurate 

8.  Level  of  instruction 

Inappropriate 

Questionable 

Appropriate 

9.  Sequence  of  instruction 

Inappropriate 

Questionable 

Appropriate 

Inclosure  1 
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ANNEX  B 


REPORT  OP  INTERVIEW 


Name  Data  , 

Course Instructions!  Unit 


Department 


Division 


COMMENTS 


Student  Input 


Instructors 


Course  Content 


Sequenca/Tima  Allocations 


Instructions!  Strategies 


Materials,  Equipoont,  and  Facilities 


Interviewer 


Inclosure  2 
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CHAPTER  14 


ANALYZING  AND  USING  TEST  RESULTS 
A.  INTRODUCTION 


1.  Purpose.  An  earlier  chapter  of  this  manual  described  the  con- 
struction of  criterion  measures.  It  will  be  recalled  that,  during  the 
development  of  the  instructional  system,  the  purpose  of  criterion  meas- 
ures (Internal  and  MOS  qualification)  is  primarily  to  determine  the 
adequacy  of  the  system  and  only  secondarily  to  evaluate  students,  diag- 
nose learning  difficulties,  and  to  serve  other  training  purposes.  How- 
ever, when  the  Instructional  system  has  been  validated,  criterion  meas- 
ures are  then  used  to  evaluate  the  training  product.  It  was  also 
emphasised  that  criterion  measures  must  be  constructed  directly  from 
the  performance  objectives  and  that  the  student  must  demonstrate  his 
ability  to  meet  or  exceed  the  prescribed  standard  for  each  of  the  train- 
ing objectives,  The  purpose  of  the  present  chapter  is  to  describe  the 
procedures  to  be  used  in  analysing  and  using  criterion  test  results. 

2 . Testing  Considerations. 

a.  Meaning  of  Tests  and  Measurements,  Human  behavior  varies 
in  many  ways.  For  example,  there  is  e great  variation  in  the  speed  and 
accuracy  with  which  different  individuals  perform  the  same  tasks. 
Numerical  values  can  be  assigned  to  a continuum  representing  the  range 
of  human  behavior  in  any  category.  Discrete  description!  of  behavior 
at  any  point  along  the  continuum  provide  a standard  egeinet  which 
observed  behavior  can  be  compared.  Measurement  is  ths  use  of  numbers 
to  compare  observed  behavior  with  such  standards.  Messuremant  Is 
obtained  by  tests.  A test  is  a means  of  observing  how  people  perform 
in  e specific,  controlled  situation.  The  teat  sets  the  tasks,  and 
numerical  valuta  are  used  to  show  how  well  the  students  perform  the 
tasks. 

b.  Testa  as  Tools,  Tests  cannot  stand  alone  from  other  ele- 
ments of  the  instructional  system,  If  they  era  to  be  truly  effective, 
they  must  contribute  directly,  systematically,  end  continuously  to  the 
ac,  ’avaoant  of  the  objectives  of  the  system.  Criterion  teste  muat, 
therefore,  be  viewed  as  tools  in  a training  program,  one  of  the  means 
used  to  achieve  the  training  objectives,  and  not  ee  an  end  in  them- 
selves, 

c.  gisential  Character tstjee  of  a Tasj;.  As  indicated  pre- 
viously in  this  manual,  criterion  tests  must  meet  certain  standards. 
Specifically,  every  teat  must  be  valid,  reliable,  objective,  end 
•tenderd,  All  teats  meet  these  requirements  to  e degree.  No  test  is 
completely  valid  or  completely  invalid;  nor  is  any  test  completely 
reliable  or  completely  unreliable.  It  is  also  important  to  remember 
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that  all  of  the  characteristics  of  a good  teat  are  closely  related, 
and  their  effects  are  interwoven.  Although  all  characteristics  of  a 
teat  are  important,  validity  ia  the  most  critical  feature  because  it  is 
related  to  the  purpose  of  the  training.  Test  analysts  must  carefully 
consider  whether  a criterion  test  actually  measures  what  it  was 
designed  to  measure.  If  it  does  not,  perfection  of  the  other  charac- 
teristics is  meaningless.  The  major  effort  in  test  construction  and 
test  analysis  must,  therefore,  be  directed  at  insuring  the  validity  of 
the  test. 

d.  Performance  Tests.  Most  of  the  criterion  measures  used 
in  instructional  systems  are  true  performance  tests.  They  are  instru- 
ments which  require  the  trainee  to  demonstrate  some  operation  or  skill 
which  is  an  essential  part  of  a job.  Usually,  some  type  of  equipment 
or  apparatus  is  Involved.  The  performance  of  the  trainee  is  observed 
and  evaluated  in  accordance  with  aome  predetermined  standard  of  per- 
formance or  product  of  performance.  Performance  tests  are  more  likely 
to  be  valid  because  they  consist  of  samples  of  behaviors  essential  to 
job,  duties,  or  tasks, 

a.  Conventional  vs  Criterion  Test  Disi vlmination.  Achieve- 
ment tests  customarily  used  in  training  programs  are  constructed  in 
such  a way  as  to  detect  small  differences  in  achievement.  To  obtain 
this  result,  tests  are  designed  with  these  objectives  in  mind: 

(1)  To  produce  a wide  range  of  scores, 

(2)  To  include  items  at  all  levels  of  difficulty, 

(3)  To  insure  that  enough  difficult  items  are  included 
to  prevent  the  teat  from  being  "broken"  (some  trainee  obtaining  a 
perfect  score). 

(4)  To  make  certain  that  each  item  differentiates  between 
low  and  high  scorers  on  the  total  test.  In  other  words,  in  most  situa- 
tions tests  are  constructed  so  as  to  achieve  a spread  of  scorea  which  la 
consistent  with  the  normal  ball  shaped  distribution  curve.  A "good"  con- 
ventional test,  therefore,  has  a mean  or  average  performance  which  permits 
"breaking  up"  the  extremes  of  the  population  tested,  A test  with  a range 
of  performance  between  40  and  80  percent  correct  is  acceptable.  To 
achieve  this  etanderd,  the  same  requirement  is  Imposed  on  test  items, 

An  item  with  a difficulty  (percentage  of  students  snawering  an  item 
correctly)  between  .40  and  .80  ia  considered  acceptable.  But,  such  items 
have  to  discriminate;  that  is,  they  must  show  a difference  in  performance 
between  high-  end  low-ecoring  trainees.  With  the  criterion  measures  of 
performance  type  tests,  these  considerations  no  longer  apply,  A criterion 
tast  raprasants  a critical  job  performance.  Each  test,  part  of  a test, 
or  teat  item  must  be  completed  successfully  in  accordance  with  the 
prescribed  standard.  The  avarage  difficulty  of  these  tests  oust  be  set 
et  or  near  1.00,  Because  all  students  must  periorm  at  the  established 
leval,  discrimination  indicas  for  criterion  testa  and  teat  items  have 
no  algnificance.  However,  the  underlying  basis  for  the  concept  of 
discrimination  ia  adequately  controlled  by  the  ^o/no-go  criterion. 
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B.  USES  OF  TEST  RESULTS 


1.  Qenaral,  Teat  reaulta  may  serve  a variety  of  purposes. 
Generally,  they  can  and  should  perform  more  than  one  function  in  a train- 
ing program.  Priorities  must  be  wetermined  according  to  importance. 

2.  Categories.  In  the  USASATC&S,  the  uses  of  test  results  may  be 
cataloged  under  three  headings:  appreisivs,  instructional,  and  adminis- 
trative. These  uses,  while  not  always  considered  as  separate  and  dis- 
tinct, are  defined  and  discussed  separately  to  develop  a clearer  under- 
standing of  each, 

a.  Aopraisive.  The  staff  and  faculty  of  the  School  need 
specific  information  regarding  the  quality  of  the  instructional  system 
and  its  effectiveness  in  attaining  the  objectives.  This  is  the  basic 
requirement  — the  one  with  the  highest  priority.  In  addition,  there 
is  a need  for  estimating  the  quality  of  the  measuring  instrument  itself 
so  that  actions  based  on  the  measures  will  be  valid.  Lastly,  there  is 
a need  for  measures  of  group  and  Individual  student  achievement/ 
performance  upon  which  to  base  administrative  and  instructional  actions. 
The  data  derived  from  test  analysis  must  be  used  to  serve  these  pur- 
poses: 

(1)  Determining  the  effectiveness  of  the  instructional 
system,  to  include  the  content,  sequence,  strategy,  instruction,  train- 
ing equipment,  training  aids,  and  instructional  materials  and  facilities, 
in  attaining  the  objectives, 

(2)  Estimating  the  effectiveness  of  the  test  in  measuring 
student  achievement. 

(3)  Measuring  how  much  a student  knows  about  a job  and 
how  well  he  can  perform  it. 

b.  Instructional . Another  important  use  of  criterion  meas- 
ures Is  to  provide  the  instructional  system  planners  and  instructors 
with  the  data  needed  to  improve  the  system,  its  components,  and  ita 
products.  Specifically,  analysis  of  test  results  can  be  used  to: 

(1)  Motivate  students  to  learn  as  much  as  they  can  in 
the  shortest  possible  time. 

(2)  Identify  groups  and  individual  students  requiring 
remedial  instruction. 

(3)  Achieve  minimum  and  uniform  standards  of  performance, 

c.  Administrative.  Criterion  measures  must  provide  * sound 
basis  for  taking  certain  administrative  actions.  Among  the  more  impor- 
tant ere  the  following: 

(1)  Counseling  deficient  etudente. 

(2)  Recycling  etudente  in  accordance  with  Agency  require- 
ments end  student  needs, 

(3)  Eliminating  incompetent  students. 

(A)  Assigning  graduates  to  duty  stations  in  accordance 
with  Agency  requirements  and  student  capabilities. 
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C.  STATISTICAL  ANALYSIS 


1.  Types  of  Statistics.  Assume  that  test  construction  hae  been 
completed  In  response  to  e requirement.  It  is  necessary,  therefore,  to 
determine  whether  the  tests  meet  the  specifications.  The  simple  ques- 
tion is,  "How  well  does  the  test  work?"  Statistical  analysis  of  test 
results  provides  an  important  measure  of  the  effectiveness  of  a test. 

Two  types  of  statistics  are  germane:  (1)  overall  test  statistics  to 
include  measures  of  central  tendency,  measures  of  test  variation, 
measures  of  reliability,  and  measures  of  difficulty;  and  (2)  test  item 
statistics  such  as  graphic  item  counts  (GIC),  measures  of  difficulty, 
and  measures  of  discrimination. 

2.  Overall  Test  Characteristics. 

a.  Pie  Mean.  The  mean  score  is  a measure  of  location  or  cen- 

tral tendency.  It  indicates  how  the  typical  individual  in  a group  per- 
formed on  the  test.  Pie  mean  la  the  average  score  and  is  computed  by 
adding  the  scores  and  dividing  by  the  number  of  scores.  Because  cri- 
terion tests  are  designed  to  test  only  essential  knowledge  and  skills, 
the  mean  must  be  at  or  near  the  maximum  possible  score,  Otherwise, 

there  is  a fault  in  the  test  or  in  the  instructional  strategy,  However, 

because  of  the  inescapable  matter  of  hirran  error,  or  an  occasional 
poorly  motivated  student,  the  meen  ecore  may  be  lowered  appreciably  by 
one  or  two  radically  different  scores.  For  this  reason,  a second  meas- 
ure of  central  tendency  must  be  calculsted. 

b.  The  Median.  Pile  is  the  score  which  divides  all  scores 

on  a test  Into  two  equal  parts;  that  is,  the  median  is  the  middle 
score  in  t group  of  scores  errsnged  in  ths  order  of  magnitude.  This 

score  le  less  effected  by  extremely  low  or  high  score*  and  provides  e 

better  measure  of  test  effectiveneae.  For  the  same  reasons  that  the 
meen  on  e criterion  test  must  be  at  or  naar  the  IqvqI  of  mastery,  so 
must  the  median  score  approach  100  percent, 

c.  Measures  of  Variation.  It  ii  not  enough  to  know  the  typ- 
ical score  on  a test  because  two  groups  of  trainees  may  have  the  aame 
or  similar  means,  but  the  spread,  scatter,  variability,  or  deviation  of 
the  scores  around  the  average  is  usually  different.  The  range  and  the 
standard  deviation  are  commonly  used  to  show  this  spread. 

(1)  The  range  is  the  distance  from  the  highest  to  the 
lowest  score  in  s series  of  scores.  On  a criterion  test  the  range 
should  approach  tero  but  can  easily  be  elteablo  If  only  one  man  faila 
to  perform  satisfactorily. 

(2)  The  standard  deviation  la  derived  by  mathematical 
formula  from  either  e frequency  distribution  or  ungroupad  data,  and 
shows  how  tha  scores  spread  around  the  mean  score.  On  a criterion  test, 
an  extremely  narrow  standard  deviation,  approaching  Svr"  is  the  ideal, 
That  is,  the  shape  of  the  curve  representing  the  results  of  e criterion 
measure  should  be  leptokurtic  in  the  extrema. 
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d.  Measure*  of  Reliability.  Cartain  etatietical  meaauras 
are  used  to  estimate  how  consistently  a test  measures  the  ability  or 
knowledge  it  is  intended  tc  measure.  These  statistics  provide  the  test 
writer  with  one  basis  £or  judging  the  worth  of  a test  and  determining 
how  much  confidence  he  can  place  in  its  results. 

(1)  The  coefficient  of  reliability  may  be  determined  by 
the  "split-half"  method.  It  provides  an  index  of  the  consistency  of  the 
measurement.  This  index  should  approximate  +1.00. 

(2)  The  standard  error  of  the  maan/maasureoent  provides 
an  estimate  of  the  accuracy  (or  inaccuracy)  of  measurement  on  a given 
test.  This  index  should  approximate  aero. 

e.  Msan  Difficulty.  The  mean  difficulty  of  a test  is  an 
index  of  the  overall  difficulty  of  the  test  items  that  comprise  the 
measure.  It  is  calculated  by  finding  the  average  difficulty  of  all 
test  items.  For  a criterion  measure,  the  mean  difficulty  should  be 
between  .90  and  1.00. 

3.  Test  Item  Characteristics. 

e.  Item  Difficulty.  The  percentage  of  testae*  answering  a 
given  item  correctly  is  the  difficulty  of  the  item.  An  item  having  a 
difficulty  of  .30  ia  a hard  item;  one  having  a difficulty  of  .90  la  an 
easy  item.  As  with  mean  difficulty,  a derivati”-  of  item  difficulty, 
item  difficulty  should  be  at  or  near  1.00. 

b.  Discrimination.  As  previously  discussed  in  this  chapter, 
discrimination  indices  for  tests  and  test  items  have  no  significance 
when  applied  to  criterion  tests.  Acceptability  of  demonatrated  per- 
formance 1s  adequately  controlled  by  the  go/no-go  criterion, 

c.  Graphic  Item  Counts  (GIC).  Where  e teat  involve*  alter- 
native anewerc,  a count  of  tha  number  of  students  selecting  each  alter- 
native may  be  made.  This  is  celled  e graphic  count  (GIC).  The  GIC  can 
be  used  to  analyse  individual  test  items  to  determine  where  the  student 
or  e aubgroup  of  students  went  wrong.  These  data  can  b*  used  as  e 
besla  for  revleing  the  teat  or  for  providing  remedial  instruction. 


D.  PROCEDURES 


1.  Statistical  Analysis. 

a.  Following  the  administration  and  scoring  of  criterion 
measures,  Chief,  Evaluation  and  M0S  Testing  Division  will  perform  sta- 
tistical analyeie  of  the  tost  end  provide  to  Chief,  Evaluation  Unit  tha 
following  data; 

(1)  The  mean  end  median  scores. 

(2)  The  range  and  standard  deviation. 

(3)  An  index  or  indices  of  test  reliability, 

(4)  The  standard  error  of  the  mean  and  tha  atsndard 
error  of  measurement. 

(3)  The  mean  difficulty  of  the  meaeuro. 
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(6)  A breakout  of  test  item  difficulties. 

(7)  A graphic  item  count,  If  applicable. 

b.  Upon  receipt,  Chief,  Evaluation  Unit  will  analyse  the 
atatietical  data  and  prepare  a report  of  findings  and  racomaandationa 
which  will  be  routed  to  the  Chief,  Evaluation  and  MOS  Testing  Division, 
Director  of  Instruction,  and  Director,  Academic  Depertinent  concerned. 

2.  Use  of  Analysis. 

a.  Director,  Academic  Department  concerned,  upon  receipt  of 
test  data  and  class  rosters,  will 

(1)  Initiate  actions  to  make  changes  in  the  instruc- 
tional systems  as  Indicated  in  the  report  of  the  Chief,  Evaluation  Unit. 
Assistance  and  coordination  will  be  provided  by  the  Evaluation  Unit 
evaluator  assigned  to  the  course  as  project  officer. 

(2)  Initiate  counseling/recycling /remediation/elimination 
actions  as  indicated  by  group  and  individual  student  performance  on  the 
test. 

(3)  Assist  tha  Chisf,  Evaluation  and  MOS  Tatting  Division 
in  revising  criterion  measures  as  raquirad. 

b.  Chief,  Evaluation  and  MOS  Tasting  Division,  upon  receipt 
of  report  from  Chief,  Evaluation  Unit,  will  initiate  action  to  revise 
the  criterion  measure  as  required,  following  the  procedures  defined  in 
e previoue  chapter  of  this  manual. 


CHAPTER  15 


FOLLOWING -UP  GRADUATES 

A.  INTRODUCTION 


1.  Purpose.  All  efforts  in  the  development  of  »n  instructional 
system  up  to  this  point  have  been  directed  toward  the  production  of  per- 
sonnel technically  qualified  to  perform  the  duties  of  their  MOS  in 
field  units.  The  real  proof  of  the  system  is  the  school  graduate's 
ability  to  perform  adequately  on  the  Job,  To  determine  the  effective- 
ness of  the  instructional  system,  and  to  provide  a basis  for  revising 
and  improving  it,  objective  data  pertaining  to  the  on-the-job  perform- 
ance of  personnel  exposed  to  the  system  must  be  collected.  The  purpose 
of  this  chapter  is  to  identify  the  kinds  of  data  needed,  the  means  to 

be  used  in  collecting  these  data,  and  the  specific  procedures  to  be 
followed  in  gathering  the  required  information. 

2.  Objectives  of  the  Followup  Program.  The  primary  objectives 
of  the  followup  program  are  to  provide  detailed  information  pertaining 
to  the  quality  of  the  job  performances  of  school  graduates  and  to  up- 
date Job  data.  That  is,  all  followup  methods  will  be  designed  to  iden- 
tify specific  weaknesses  of  graduates  of  the  system  end  to  recheck  the 
list  of  job  duties,  tasks,  and  elements  gathered  by  the  Job  analysis 
teams. 


3*  Uses  of  Followup  Data;  Data  collected  by  means  of  the  followup 
program  will  be  used  by: 

a.  Curriculum  builders  to  modify  the  objectives,  content, 
sequence,  emphases,  and  time  allocations  of  instructional  systems. 

b.  Instructors  to  adapt  instructional  atrateglea  ao  as  to 
ramedy  daficiencies  uncovered. 

c.  Testing  personnel  to  modify  criterion  measures  used  in 
evaluating  student  achievement,  to  validate  MOS  qualification  tosts, 
and  to  revise  teats  produced  for  use  in  the  DA  MOS  Evaluation  Program, 

^ > Methods  of  Collecting  Pats.  There  are  aevtral  complementary 
raathods  of  collecting  followup  date.  At  one  time  or  another,  all 
mathoda  will  be  used. 

* • ^jald_Syalu»tion  Followup  Teems,  The  moet  reliable 
sources  of  date  on  how  well  the  product  of  the  instructional  system  per- 
forms his  duties  ere  the  graduate  himself,  his  Irssediete  supervisor, 
othsr  supervisory  psrsonnel,  and  fiald  unit  cocsamders.  This  fact  dic- 
tates ths  establishment  of  followup  fi?ld  evaluation  teem*,  these 
teems  ers  selected  and  trainad  to  perform  field  avalustion  followup 
using  standardised  and  validated  interview  and  observation  procedures 


and  techniques,  and  associated  data-collectlon  Instruments.  Mi  method 
Is  the  primary  means  of  collecting  evaluation  data.  It  Involves  observa- 
tion and  interview  of  graduates  of  the  system  on  the  job  and  interviews 
with  supervisory  personnel  (trick  chiefs,  NCOIC's,  QIC's  and  operations 
officers)  and  unit  commanders. 

b.  Secondary  Methods.  The  following  secondary  methods  of 
collecting  data  pertaining  to  the  quality  of  the  performance  of  school 
graduates  will  be  used  to  complement  the  field  evaluation  followup 
teams. 

(1)  Analysis  of  DA  MOS  Tests.  Review  and  analysis  of 
tests  administered  to  school  graduates  in  connection  with  the  DA  MOS 
Evaluation  System  can  provide  data  pertaining  to  their  strengths  and 
weaknesses. 

(2)  Interviews  with  officer  and  NCO  field  returnees. 
Officers  and  NCO's  assigned  or  TDY  to  HQ,  USASA  or  to  the  USASA7C&S 
following  overseas  tours  of  duty  with  ASA  units  can  provide  valuable 
data  relating  to  the  performance  of  the  graduate  and  his  strengths  and 
weaknesses.  Full  advantage  must  be  taken  of  those  data  collection 
opportunities. 

(3)  Reports  of  HQ,  USASA  and  NSA.  HQ  USASA  and  NSA  staff 
sections,  as  recipients  of  the  products  produced  by  graduates  of  the 
system,  can  provide  valuable  data  relating  to  the  adequacy  of  the  train- 
ing program. 

c.  Alternative  Method.  During  periods  of  austerity,  result- 
ing in  nonavailability  of  funds  or  personnel  required  to  support  field 
evaluation  visits,  questionnaire  surveys  may  be  used  to  collect  evalua- 
tion data.  Questionnaires  will  be  designed  to  elicit  specific  informa- 
tion, relating  to  the  strengths  and  weaknesses  of  graduates  of  the  sys- 
tem, from  the  graduates  themselves,  their  immediate  supervisors,  other 
supervisory  personnel,  and  unit  commanders. 


B.  FIELD  EVALUATION  FOLLOWUP  TEAMS 


1.  Mission.  The  mission  of  the  Field  Evaluation  Followup  Teams 
is  to: 

a.  Collect,  record,  and  report  deficiencies  in  knowledge  and 
skills  displayed  by  graduates  of  the  instructional  system  assigned  to 
T DA /TOE  positions  in  ASA  units, 

b.  Collect,  record,  and  report  suggestions  made  by  personnel 
at  field  units  to  Improve  specific  instructional  systems, 

c.  Collect,  record,  and  report  changes  in  the  duties,  tasks, 
and  alamants  of  an  MOS,  shifts  in  emphases,  end  changes  In  equipmant, 
procedurss,  and  techniques, 

2*  Composition.  Field  eveluatlon  followup  will  be  performed 
only  by  careful  selected  military  and  civilian  peraonnsl  who  have  besn 
trslnsd  for  the  conduct  of  followup  observation  and  interview.  Team 
mambare  may  be  drawn  from  any  alamant  of  the  USASA7C&S  staff  and  faculty. 


P 
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3.  Training.  A formal  count  of  Inatrucclon,  daalgnad  to  prepare 
aalactad  members  of  tha  ataff  and  faculty  to  perform  flald  evaluation 
follovup,  trill  ba  daalgnad  and  praaantad  by  Chief,  Evaluation  Unit  aa 
required . 


C.  PROCEDURES  FOR  THE  CONDUCT 
OF  FIELD  EVALUATION  FOLLOWUP 


1.  Planning  Steps.  The  team  chief  with  the  aaaiatance  of  team 
member a will: 

a.  Identify  the  apecific  claaa  or  cleaaea  to  be  followed  up. 

b.  Identify  the  apecific  unite  to  which  graduate*  of  tha 
cleat  have  been  aaaignad. 

c.  Select  unite  to  be  visited  which  - 

(1)  Are  rapreaentative  In  terms  of  major  ASA  miaalona; 
e.g.,  atrateglc/tactlcal,  fixed /semi fixed /mob lie, 

(2)  Reflect  "typical"  job  requirements  of  the  job 
Development  System  being  studied. 

(3)  Are  geographically/environmantally  representative, 

d.  Notify  units  of  the  purpose,  time,  and  duration  of  visits. 

e.  Review  documents  relating  to  -- 

(1)  The  mission,  organisation,  and  capabilities  of  units 
to  be  visited. 

(2)  Equipment  authorisation  for  units  to  be  visited. 

f . Review  Job  analysis  schedules  produced  by  U3ASA  Ccanand 
Job  Analysis  Teams. 

g.  Review  existing  Army  Regulation  Job  Description. 

h.  Prepare  end  rehearse  standard  brlaflng  for; 

(1)  Theater  commanders, 

(2)  Unit  commander*. 

(3)  Suporvieory  personnel. 

(4)  School  graduatea. 

i.  Develop  detailed  procedures  end  materials  for  the  conduct 
of  observations  end  interviews . 

J.  Dry-run  procedures. 

2.  Conduct  of  Field  Evaluation  Followup  at  Units.  The  teem  chief, 
eeeleted  by  team  members,  will: 

e.  Brief  commanders  on  purposes,  procedures,  and  requirements, 
including: 

vl)  Why  tht  follovup  is  being  performed, 

(2)  Whet  the  team  require#  in  the  way  of  aseiatance  and 

support, 

(3)  How  the  team  plana  to  conduct  the  follovup. 

(4)  How  the  followup  date  will  be  used. 
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b.  Study  the  mission,  organisation,  and  function*  of  th*  unit. 

(1)  Study  organisational  chart*  and  discus*  with  super- 
visory personnel  to  determine  their  accuracy  in  t*rm*  of  th*  "real"  oper- 
ational structure. 

(2)  Study  local  directives,  instructions,  and  SOP  govern- 
ing unit  operations.  Pay  particular  attention  to  document*  which  relate 
to  the  MOS  under  consideration. 

c.  Brief  supervisory  personnel  on  the  purpose  and  procedure* 
of  the  followup. 

(1)  Include  the  same  information  provided  the  commander. 

(2)  Specify  the  assistance  required. 

(3)  Set  up  a definite  time  for  interview*. 

d.  Review  th*  record*  of  graduate*  to  be  interviewed  and 
observed,  and  note  pertinent  data  on  followup  form*. 

e.  Brief  graduates  on  the  purposes  and  procedure*  of  th* 

followup. 

(1)  Include  pertinent  item*  from  the  standard  briefing. 

(2)  Set  a definite  time  for  interview  and  observation. 

(3)  Ask  th*  graduate  to  do  some  preliminary  thinking 
about  his  duties  and  how  well  he  perform*  them. 

f.  Interview  supervisory  personnel. 

g.  Observe  the  graduate  on  th*  job. 

h.  Interview  the  graduate. 

i.  Cross-check  discrepancies  between  the  graduates'  responses 
and  supervisor's  responses  with  immediate  supervisor. 

J.  Interview  CO/Opns  officer. 

k.  Conduct  Interview*  using  the  following  techniques  I 

(1)  Allow  minimum  time  for  interviews  as  follows) 

(a)  Supervisory  personnel  - 1 hour. 

(b)  Graduates  * 1 hour. 

(c)  Operations  of floors  and  CD's  - SO  minutes. 

(2)  Establish  rapport  before  getting  on  with  the  business 
of  the  interview, 

(3)  Conduct  th*  Interviews  In  a place  that  is  private  and 
tree  from  distractions. 

(4)  Establish  a friendly,  cooperative  working  relation- 
ship with  th*  Interviewee. 

(5)  Deal  with  th*  interviewee  in  a forthright,  sincere 
manner,  and  listen  attentively  to  his  comments. 

(6)  Avoid  evidences  of  pressure,  boredom,  or  irritation} 

be  patient. 

(7)  Avoid  antagonising,  embarrassing,  or  hurrying  the 

interviewee. 

(8)  Display  an  objective  but  not  a disinterested  attitude. 

(9)  Accept,  unperturbed,  expressions  of  negative  feelings, 
such  as  hostility  and  highly  subjective  or  destructive  criticism. 

(10)  Encourage  the  interviewee  to  state  his  views  completely 
and  without  fear  of  censure  or  reprisal  for  honest  crltioism. 


Best 


;u 
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(11)  Cover  all  points  on  tha  standard  lntarviaw  form  and 
tnaka  all  entrlas  required. 

(12)  Summarise  th«  main  points  to  ba  sure  that  you  hava 

a clear  and  complete  plctura  of  the  interviewee's  obaarvationa  and  eval- 
uations. 

(13)  End  tha  interview  whan  tha  interviewee  can  no  longer 
give  you  pertinent  and  usable  information. 

l.  Observe  tha  graduate  perform  the  duties  and  tasks  of  his 

NOS. 

(1)  Observe  long  enough  to  see  performance  of  all  major 

duties. 

(2)  Ask  questions  only  when  necessary, 

(3)  Make  notes  of  your  observations. 

m.  Provide  an  exit  briefing  for  the  unit  commander, 

(1)  Summer las  your  fiudinga  by  WOS. 

(2)  Provide  the  cotnaander  with  an  opportunity  to  make 
additional  cocroents  and  rscommandstions . 

3- 

a.  Team  chiefs,  asslstad  by  tsam  members,  will  consolidate 
and  tabulate  collected  data  and  forward  to  Chief,  Evaluation  Unit. 

b.  Chief,  Evaluation  Unit  will: 

(1)  Analyse  the  data, 

(2)  Prapare  a report  and  aubmit  tha  report  for  oonsaant  to 

(a)  Educational  Conaultant. 

(b)  Technical  Consultant 

(c)  Director  of  Instruction 

(d)  Director,  Responsible  Academic  Department . 

(3)  Upon  receipt  of  comments,  make  required  ohangee  in 
the  Performance  Objective  Workcerde  using  procedures  described  in 
chapters  3 and  4 of  this  manual. 

(4)  Coordinate  required  change!  in  criterion  mceeuvea, 
course  content,  sequencing,  end  time  allocation!,  instructional  strata^ 
glee,  equipment  end  instructor  requirements,  course  prerequisites,  and 
instructional  materials,  Thasa  changes  will  be  effected  by  the  respon- 
sible academic  or  staff  element  in  accordance  with  the  procedures 
defined  in  the  appropriate  chapter  of  this  manual. 


D,  PROCEDURES  FOR  USING 

SECONDARY  METHODS  OF  FOLLOWUP 


l*  AM.ly.ftil.  Ol.  DA_tSQS._Svalua.tion  mats, 

a.  Following  the  adminie tret  ion  end  scoring  of  DA  KQS  eval- 
uation teste,  Chief,  Evaluation  end  MDS  Test  Division  willt 

(1)  Obtain  consists  statistical  data  for  the  tast  frost 
CO,  US  Army  Enlisted  Evaluation  Center. 
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( I ) Identity  and  tabulate  dlatribut Iona  of  acoras  tor 
personnel  exposed  to  the  new  instruction  system. 

(J)  Perform  an  analysis  of  test  results  to  identify  spe- 
cif ir  weaknesses  of  school  graduates  on  the  test. 

(4)  Prepare  a report  of  findings  and  recommendations  and 
route  copies  for  comment  in  turn  as  follows: 

(a)  Technical  and  Educational  Consultants. 

(b)  Director  of  Instruction. 

(c)  Director,  Responsible  Academic  Department. 

(d)  Chief,  Evaluation  Unit, 

b.  Upon  raceipt  of  conroents,  Chlaf,  Evaluation  Unit  will 
coordinate  necessary  changaa  in  tha  syatara  aa  proscribed  in  tha  appro- 
priate chapters  of  this  manual. 

2-  Interview!,  with  Field  Returnees. 

a.  Policy.  All  newly  assigned  USASATC&S  officer  and  NCO  per- 
sonnel returned  from  oversea  assignments  will  be  interviewed  regarding 
technical,  doctrinal,  tactical,  or  operational  nw iters  which  pertain  to 
any  mission  of  tha  US  Army  Security  Agency,  Writton  records  of  all  inter- 
views will  be  kept.  Information  obtained  will  be  supplied  to  staff  and 
academic  elements  of  USASATC&S.  This  Information  will  be  screened, 
evaluated,  and  where  appropriate,  promulgated  in  training  literature 

and  academic  instruction. 

b.  Procedures. 

(1)  The  Director  of  Personnel  end  Administration  will, 

on  Wednesday  of  each  weak,  provide  the  nemea  of  nil  newly  assigned  per- 
sonnel to  the  Office  of  Training  Literature, 

(2)  The  Director,  Offioe  of  Training  Literature  will: 

(a)  Interview  all  nawly  assigned  personnel  and  keep 
written  or  taped  records  of  eaoh  Interview,  to  include,  but  not  be 
limited  to,  the  following  items t 

Name,  rank,  service  number,  NOS,  previous 

unit  end  duty  assignment. 

2.  Technical,  doctrinal,  tactical,  and  opera- 
tional information. 

2*  Spacific  details  of  any  unusual  or  apeolal 
activity  or  Information, 

i.  Information  regarding  whether  training 
received  before  going  oversees  wea  sufficient  to  accomplish  hie 
assigned  tasks;  if  not,  tha  specific  deficiencies  will  be  reoorded, 

(b)  Send  requests  to  other  ASA  units  for  followup 
information  on  Items  deemed  worthy  of  additional  study, 

(o)  Develop  a standardised  briefing  form  to  Include 
pertinent  specific  requests  for  information  suggested  by  staff  and  aca- 
demic elements . 

(d)  Refer  ths  person  being  interviewed  to  other 
staff  or  academic  elements  of  the  USA8A7C&I  for  additional  interview* 
upon  raquast  from  tha  ataff  or  aoadamlo  elemant  concerned*  Xn  iueh 
cases,  a rapraaantatlv*  from  tha  Offioe  of  Training  Literature  will 
accompany  the  person  bslng  intsrviewed  and  will  remain  present  during 


the  interview.  Thia  procedure  la  nacasaary  to? 

Avoid  useless  duplication  with  tha  accom* 

panying  Ion  of  time  and  inconvanianca  to  th#  interviewer  and  to  tha 

ptraon  baing  interviewed. 

I . Inaura  that  all  partlnant  Information 

obtained  from  the  paraon  la  permanently  recorded  and  retained  by  the 

Office  of  Training  Literature. 

(e)  When  appropriate,  lunmariaa  and  forward  to  HQ, 

USASA  information  obtained  from  interview#.  If  the  paraon  interviewed 
muat  report  to  higher  headquarter*  for  additional  debriefing,  a re qua at 
for  a recorded  copy  of  thia  debriefing  will  be  initiated  and  aant  by 
the  Office  of  Training  Litaratura  to  tha  headquarter*  eoncarnod. 

(f)  Routa  a copy  of  tha  writtan  summary  of  aach 
intarviaw  to  tha  Assistant  Commandant;  Tachnical  Conaultcnt;  Educational 
Consultant;  Chiaf,  Evaluation  Unit;  CO,  USASATR;  Diractor  of  Instruction; 
Diractor,  Peraonnal  and  Administration;  Director,  Plane  and  Programa  and 
Diractor,  Logiitica , 

(3)  Each  staff  and  academic  aleaant  to  whioh  writtan 

records  of  interview#  are  sent  will: 

(a)  Review  them  and  request  tha  Diractor,  Office  of 
Training  Literature  to  make  arrangement*  for  any  further  interviews 
required  by  chtm. 

(b)  Assist  tha  Offica  of  Training  Litaratura  to 
obtain  and  racord  accurata,  conciaa  and  coraplat#  auawfirias  of  all  par* 
tinant  technical,  doctrinal,  or  optrational  information  obtained  from 
personnel  baing  intarviavad, 

(c)  Evaluttt  and  report  to  the  Chiaf,  Evaluation 
Unit  and  Offica  of  Training  Literature  it§  determination  of  th*  useful- 
ness end  validity  of  all  information  t tainad  from  the  parson  baing 
interviewed, 

(d)  Submit  to  the  Director  of  Training  Literature 
•pacial  request*  fer  information  concerning  itama  about  which  th*y 
rtquir*  explanation  or  clarification, 

(4)  Recommendation*  for  changae  to  th*  eyaeaa,  if  indicated, 
will  be  submitted  through  Chiaf,  Evaluation  Unit  for  staffing  wish  aoa- 
dtoic  and  etaff  elements  as  notud  in  paragraph  Dl(4)  shove , 

(3)  Upon  receipt  of  counts,  Chief  Evaluation  Unit  vtU 
coordinata  neceeeary  changae  in  the  eyetea  ee  prescribed  in  the  appro- 
priate chapter  of  thia  manual. 

3.  Raoorte  of  HQ,  USASA  end  MSA. 

a.  Ai  requifed.Lut  at  least  annually,  Chiaf,  Evaluation  Uhit 

will  solicit  the  cocssents  of  chiefs  of  appropriate  staff  section*  at 
HQ,  USASA  and  KSA  regarding  ths  quality  of  satarialt  .*j*3  ad- 

mitted by  ASA  oparating  units.  Theae  comment*  «ay  b*  obtained  fey  quaa* 
tionnaires  or  visits. 

b.  Raports  of  findings  end  ?ecoee»nd*t Iona  will  b*  routed  for 
comment  as  indicated  in  paragraph  El (4)  above. 
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c.  Upon  receipt  of  coonenta,  Chief,  Evaluation  Unit  will 
coordinate  neceaaary  changes  in  the  system  aa  prescribed  in  the  appro- 
priate chapters  of  this  manual. 


E.  PROCEDURES  FOR  CONDUCTING 
QUESTIONNAIRE  SURVEYS 


1.  Conditions  of  Use.  Questionnaire  surveys  for  the  followup 
evaluation  of  graduates  of  pilot  courses  will  be  used  when  shortages  of 
funds  or  personnel  preclude  the  conduct  of  field  evaluation  followup 
visits.  Questionnaire  surveys  may  also  be  used  for  collecting  addi- 
tional data  on  specific  programs  of  instruction. 

2.  Types  of  Queetionnairss.  Questionnaires  will  be  prepared  by 
Chief,  Evaluation  Unit  for  each  program  of  instruction.  Separata  ques- 
tionnaires will  be  designed  for  graduates  of  the  system,  their  immediate 
supervisors,  and  unit  commanders  (or  operations  officers). 

3.  Format  and  Content  of  Questionnaires. 

a.  Questionnaires  will  be  designed  to  permit  machine  tabula- 
tion of  responses  wharavar  possible. 

b.  Questionnaires  will  Include  e complete  breakout  of  tha 
duties,  tasks,  and  elaments  of  the  Job  being  evaluated. 

c.  Space  will  be  provided  for  indicating  whather  or  not  tha 
duty,  task,  or  alement  is  perfomsd,  tha  frequency  of  performance,  th* 
importance  of  the  duty,  task,  or  element,  the  quality  of  the  graduate1! 
parformance,  and  cesaaanta  and  racossaandatioos  of  tha  respondent, 

A.  Sampling,  All  members  of  a pilot  course,  and  their  super- 
visors will  be  surveyed,  In  the  case  of  special  surveys,  a saaplt  of 
20  per  cent  of  th*  graduates  of  the  year  preceding  the  survey  will  be 
considered  adequate, 

5. 

a.  Chief,  Evaluation  unit  will  analyse  the  summary  and  pre- 
pare a report,  with  recotaaandetiona  for  changes  to  the  system,  and  for- 
ward to  the  following  for  cota&ant: 

(1)  Technical  fend  Educational  Consultants. 

(2)  Dirsctor  of  Instruction, 

(3)  Director,  Jp*  ■pans  ibis  Academic  Department, 

b,  Upon  recaipt  of  basements,  Chief,  Evaluation  Unit  will 
coordinate  required  changes  in  Accordance  with  procedural  defined  in 
the  appropriate  chapter*  of  this  manual, 
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ANNEX  A 
INTERVIEW  FORM 
SUPERVISORS 


Unit  Identification 
Interviewee  


Circle 
One  QIC 


NCOZC  TC 


Nam*  of  Graduate  _________ „ MOS  ___________ 

1.  In  comparison  with  othar  roan  in  this  MOS  of  tha  setae  grade  and  experi- 
ence, how  do  you  rata  this  graduate? 

Above  Balov 

Circle  one:  Outstanding  Average  Average  Average  Unsatisfactory 

2.  Rate  this  man's  performance  on  each  of  the  following  job  tasks/e lament® 
and  Identify  specific  deficiencies  in  knowledge  or  skill  * 


1 

lating 

Job  Tasks/Elements 

2 

G 

iti 

N/A 

Deficiencies 

1. 

2. 

3. 

4. 

5. 

i 

t 

i 

: 

i 

i 

i 

! 

■ 

• 

3.  What  can  the  School  do  to  improve  training  in  this  MOS/ 

iif 

U . 


4,  Other  comments? 


Interviewer 


i 


i 
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ANNEX  B 


INTERVIEW  FORM 
GRADUATES 

Unit  Identification  MOS 

Nana  of  Interviewee  Grade  

Rank  in  Grad  Claae  Supervisor *s  Rating  ____________ 

1.  How  many  weeka  elapeed  f rots  the  tine  yotf  graduated  and  the  date  you 
reported  for  duty?  _____ _____ _____  veeke. 

2.  How  many  daye  of  OJT  did  you  have  before  being  placed  on  poaltlon? 

. daye. 

3.  How  long  have  you  bean  on  position?  _______  weeks. 

4.  Code  epaed  (for  &)S  05D,  050,  OSH,  G3K  only). 

a.  Code  speed  upon  graduation?  __________  GPH 

b.  code  speed  on  arrival  and  prior  to  OJT?  QFM 

c.  Days  required  to  get  to  position  code  speed?  ______  days 

d.  Present  coda  speed?  _____  GPH 

5.  Rate  yourself  on  each  of  the  job  tasks  or  elements  In  this  list. 


Job  Tasks /Elements 

I Retina 

N/A 

Consents 

8 

G 

F 

p 

1. 

2. 

3. 

L. 

" 
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AfflttX  B (cost) 


/ 


6.  With  which  «ap«cts  of  your  job  do  you  have  the  most  difficulty? 


7,  What  can  the  School  do  to  improve  training  in  your  NOS? 


Interviewer 
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ANNEX  C 


INTERVIEW  FORM 

COMMANDING  OFFICERS /OPERATIONS  OFFICERS 
Unit  Identification  


Circle 

Interviewee  __________ _____ ________________  One  CO  Opne  0 

1.  How  to  graduates  of  these  courses  coopers  with  graduates  of  earlier 
classes? 


MOS 

No. 

Grads 

Better 

About  the 

Same 

Poorer 

. 

1 

2.  In  what  specific  ways  are  they  better /poorer? 


3.  What  was  the  level  of  Job  proficiency  brought  to  your  unit  by  school 
graduates  in  these  MOS? 


MOS 

Excellent 

Good 

Fair 

Poor 

! 

